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(4)  Introduction 

The  goal  of  this  project  is  to  develop  a  digital  stereoscopic  imaging  technique  for 
mammography.  We  hypothesize  that  stereoscopic  imaging  can  be  a  practical  technique  with 
current  detector  and  display  technology,  and  stereoscopic  imaging  will  improve  the  detection  and 
analysis  of  breast  lesions,  especially  for  dense  breasts.  The  improvement  results  from  the  facts 
that:  (1)  digital  imaging  systems  generally  can  provide  better  contrast  sensitivity  for  imaging 
dense  tissues,  (2)  the  over-  and  underlying  dense  tissues  will  be  separated  from  the  lesion  in  the 
stereoscopic  views  thereby  increasing  the  conspicuity  of  the  lesion,  and  (3)  the  ability  to  analyze 
the  3-dimensional  distributions  and  shapes  of  lesions  such  as  calcifications  and  masses  within  the 
breast  can  potentially  improve  the  accuracy  of  mammographic  image  interpretation  by  radiologists 
and  reduce  unnecessary  biopsies. 

To  accomplish  this  goal,  we  first  performed  phantom  studies  to  develop  an  optimal 
imaging  technique  for  the  acquisition  of  the  stereoscopic  images.  This  included  the  determination 
of  the  stereoscopic  angle,  the  magnification  factor,  and  the  dose  requirements  in  comparison  with 
those  for  a  single-image  technique.  To  view  the  digital  stereoscopic  images,  we  developed  a 
stereoscopic  viewing  station  with  a  high-resolution  stereo  graphics  board  and  monitor.  We  also 
developed  and  implemented  software  for  panning  and  roaming  the  displayed  images  and  for 
adjusting  the  contrast  and  brightness  of  the  images.  A  stereoscopic  viewer  with  an  LCD  shutter  is 
used  to  separate  the  left  eye  and  right  eye  images.  Any  one  image  of  the  stereoscopic  pair  can  also 
be  viewed  independently  as  in  a  conventional  single-image  reading  condition.  The 
stereomammography  imaging  technique  was  evaluated  with  an  observer  performance  experiment 
in  which  the  accuracies  of  experienced  radiologists  in  characterizing  lesions  and  in  determining 
margin  clearance  were  compared  for  readings  of  mono  and  stereo  images  of  biopsy  tissue 
samples. 

In  the  course  of  the  research,  we  also  developed  a  new  idea  of  using  a  virtual  cursor  for 
absolute  depth  measurements  of  objects  in  stereo  images.  A  series  of  observer  experiments  with 
phantom  images  was  performed  to  demonstrate  the  usefulness  and  evaluate  the  accuracies  of 
depth  measurement  using  virtual  cursors. 

In  summary,  we  performed  an  extensive  investigation  of  the  dependence  of  the  accuracies 
of  depth  discrimination  and  depth  measurement  on  image  acquisition  techniques  in  digital 
stereomammography.  We  also  developed  software  tools  for  the  manipulation  of  the  displayed 
stereo  images  and  for  the  measurement  of  the  depth  of  a  lesion  in  the  images.  These  tools  were 
developed  for  two  different  stereo  display  workstations.  Observer  experiments  were  performed  to 
evaluate  the  stereomammography  imaging  technique  using  phantoms  and  biopsied  breast  tissue 
samples.  The  results  indicate  that  stereoscopic  imaging  is  a  promising  technique  that  may  provide 
3D  information  for  the  detection  and  characterization  of  breast  lesions.  Further  studies  are 
warranted  to  investigate  whether  stereomammography  can  improve  the  sensitivity  of 
mammography  for  breast  cancer  detection,  especially  in  dense  breasts. 
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This  is  the  final  report  of  our  project.  In  the  project  period  (4/20/98-4/19/03),  we  have 
performed  a  number  of  studies  to  develop  the  digital  stereoscopic  imaging  technique.  The 
detailed  studies  and  results  have  been  reported  previously  in  the  annual  progress  reports.  A 
summary  of  some  of  the  important  accomplishments  follows. 

(A)  Development  of  Stereo  Display  Workstations  and  Graphical  User  Interface 

Since  there  is  no  high-resolution  stereo  workstation  commercially  available  for  the 
display  of  digital  stereomammograms,  we  had  to  work  with  manufacturers  of  high  quality 
medical  image  displays  to  develop  appropriate  displays  of  the  stereomammograms  obtained  in 
this  project.  Two  stereo  display  workstations  were  developed  in  the  course  of  this  study: 

(1)  Barco-Metheus  SUN-based  stereo  display  workstation 


Figure  1.  Barco-Metheus  SUN-based  stereoscopic  display  workstation. 


The  first  system  that  we  acquired  consists  of  a  model  1760S  Barco-Metheus  (Beaverton, 
OR)  stereoscopic  graphics  board  in  a  SUN  Microsystems  (Palo  Alto,  CA)  Ultra  10  computer 
that  drives  a  Barco  model  521  (5  Megapixel)  21”stereo  display  monitor.  The  Barco-Metheus 
graphics  board  displays  1408  x  1408  x  8  bit  images  at  a  refresh  rate  of  114  Hz.  It  operates  in  a 
page  flipping  stereoscopic  mode  with  the  left-  and  right-eye  images  displayed  alternately. 
NuVision  (Beaverton,  OR)  LCD  stereoscopic  glasses  were  used  for  viewing  the  stereoscopic 
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images.  We  chose  this  system  because  it  was  the  only  high-resolution  stereo  display  system 
available  at  a  reasonable  price  at  that  time.  In  addition,  we  originally  planned  to  acquire  stereo 
images  with  a  Fischer  core  biopsy  digital  unit  that  has  a  1024  X  1024  image  matrix  size  so  that 
the  display  resolution  was  adequate.  The  stereo  workstation  is  shown  in  Fig.  1.  We  have 
developed  image  manipulation  software  such  as  windowing,  zooming,  panning,  and  a  number  of 
virtual  cursors  for  the  workstation.  All  phantom  experiments  were  conducted  using  this  display. 

(2)  Dome-MegaScan  PC  based  Stereo  Display  Workstation 

In  the  summer  of  2000,  our  department  purchased  the  first  commercially  available  full 
field  digital  mammography  (FFDM)  system  by  General  Electric  Medical  System  (Senographe 
2000D;  Milwaukee,  WI)  for  the  breast  imaging  clinic.  Because  the  FFDM  system  had  greater 
potential  for  future  clinical  applications  than  the  small  (5  cm  x  5  cm)  field  Fischer  core  biopsy 
unit,  we  decided  to  employ  the  FFDM  system  for  the  acquisition  of  digital  stereo  mammograms 
for  our  project.  The  matrix  size  of  the  FFDM  images  is  about  2300  x  1900.  However,  the 
Metheus-Barco  system  can  only  display  1408  x  1408  stereo  images  at  a  1 14  Hz  refresh  rate.  It 
therefore  cannot  display  the  entire  full  field  stereomammogram  at  once,  and  requires  the  use  of 
panning  for  the  visualization  of  all  parts  of  the  mammograms. 


Fig.  2.  The  DOME-MegaScan  PC-based  high-resolution  stereo  display  workstation.  The  first 
full-field  stereomammogram  acquired  for  this  project  is  shown  on  the  monitor. 

The  DOME  Imaging  System,  Inc,  which  is  a  manufacturer  of  high  quality  display 
equipment  for  medical  x-ray  images,  started  to  develop  a  stereo  display  system  when  the  FFDM 
became  available.  They  sold  us  a  beta-version,  state-of-the-art  high-resolution  stereo  display 
system  at  a  greatly  discounted  price.  The  new  display  system  consists  of  a  DOME  Md8-4820-LS 
stereo  graphics  board,  a  MegaScan  Md8-4820-LS  (8  Megapixel)  2K  stereo  monitor,  Crystal  Eyes 
stereo  glasses,  and  a  Dell  OptiPlex  1.8  GHz  computer.  The  DOME-MegaScan  system  is  the  only 
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system  to-date  that  can  display  full-field  digital  stereomammograms  at  full  resolution  (2304  x 
1800)  and  a  refresh  rate  of  120  Hz.  It  can  also  display  two  full-field  digital  mammograms  in  non¬ 
stereo  mode  at  a  refresh  rate  of  120  Hz.  The  system  is  shown  in  Fig.  2. 

Since  the  DOME  Md8-4820-LS  stereo  graphics  board  and  the  stereo  display  system  are 
not  commercial  products,  the  display  functions  and  the  user  interface  are  not  well  developed.  We 
had  to  develop  software  to  incorporate  all  of  the  features  of  our  previous  stereo  display  system 
including  contrast  enhancement  of  12-bit  DICOM  images,  zooming  and  panning  of  the  displayed 
images,  and  superposition  of  a  virtual  cursor  on  the  images  for  depth  measurements.  In  addition, 
a  graphical  user  interface  (GUI)  was  incorporated  into  the  display  window  for  the  observer 
performance  experiment  that  compared  stereo  images  and  plain  images  of  breast  tissue 
specimens. 

(B)  Design  and  Built  Stereoscopic  Breast  Phantoms 

We  designed  two  stereoscopic  breast  phantoms  to  evaluate  the  stereomammographic 
techniques  using  the  GE  full  field  digital  mammography  system.  We  had  CIRS,  Inc.  built 
prototypes  of  these  phantoms.  The  first  one  is  a  rigid  breast  shape  phantom  in  which  10  groups 
of  simulated  microcalcifications  and  8  spiculated  masses  are  embedded  at  different  depths.  The 
depths  of  the  center  of  each  group  of  microcalcifications  and  masses  are  provided  by  the 
manufacturer.  A  piece  of  blue  "SMUD"  (a  PLAYDO-like  substance  manufactured  by  Mattel, 
Inc.)  molded  into  an  irregular  shape  can  be  placed  on  top  of  the  phantom  to  simulate  dense 
tissue.  The  SMUD  produces  an  under-penetrated  area  in  the  x-ray  image  similar  to  that  in  a  very 
dense  breast.  The  second  phantom  is  a  compressible  breast  shape  phantom  with  simulated 
clustered  microcalcifications  and  masses  suspended  in  a  tissue-equivalent  gel.  The 
stereomammograms  of  these  phantoms  were  shown  in  our  previous  report. 

(C)  Evaluation  of  Depth  Measurements  using  a  Stereo  Virtual  Cursor 

In  the  course  of  the  project,  we  conceived  the  idea  of  using  a  virtual  cursor  for 
measurement  of  depth  in  stereomammograms.  We  evaluated  whether  the  improved  depth 
perception  associated  with  stereomammography  might  be  significantly  enhanced  with  the  use  of 
a  virtual  3-D  cursor.  A  study  was  performed  to  evaluate  the  accuracy  of  absolute  depth 
measurements  made  in  stereomammograms  with  such  a  cursor  [Reportable  Outcomes,  Journal 
Articles  #1],  The  Fischer  core  biopsy  unit  was  used  to  produce  digital  stereo  images  of  a 
phantom  containing  50  low  contrast  fibrils  (0.5-mm  diameter  nylon  monofilaments)  at  depths 
ranging  from  0  to  10  mm,  with  a  minimum  spacing  of  2  mm.  Half  of  the  fibrils  were  oriented 
perpendicular  (vertical)  and  half  parallel  (horizontal)  to  the  stereo  shift  direction.  The  depth  and 
orientation  of  each  fibril  were  randomized,  and  the  horizontal  and  vertical  fibrils  crossed, 
simulating  overlapping  structures  in  a  breast  image.  Left  and  right  eye  images  were  generated  by 
shifting  the  x-ray  tube  from  +2.5°  to  -2.5°  relative  to  the  image  receptor.  Three  observers  viewed 
these  images  on  a  computer  display  with  stereo  glasses  and  adjusted  the  position  of  a  cross¬ 
shaped  virtual  cursor  to  best  match  the  perceived  location  of  each  fibril.  The  x,  y  and  z  positions 
of  the  cursor  were  indicated  on  the  display.  The  z  (depth)  coordinate  was  separately  calibrated 
using  known  positions  of  fibrils  in  the  phantom.  The  observers  analyzed  images  of  two 
configurations  of  the  phantom.  Thus,  each  observer  made  50  vertical  filament  depth 
measurements  and  50  horizontal  filament  depth  measurements.  These  measurements  were 
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compared  with  the  true  depths.  The  correlation  coefficients  between  the  measured  and  true 
depths  of  the  vertically  oriented  fibrils  for  the  3  observers  were  0.99,  0.97,  and  0.89  with 
standard  errors  of  the  estimates  of  0.39  mm,  0.83  mm,  and  1.33  mm,  respectively. 
Corresponding  values  for  the  horizontally  oriented  fibrils  were  0.91,  0.28,  and  0.08,  and  1.85 
mm,  4.19  mm,  and  3.13  mm.  All  observers  could  estimate  the  absolute  depths  of  vertically 
oriented  objects  fairly  accurately  in  digital  stereomammograms;  however,  only  one  observer  was 
able  to  accurately  estimate  the  depths  of  horizontally  oriented  objects.  In  a  subsequent  study 
[Reportable  Outcomes,  Conference  Proceedings  #2],  we  found  that  most  observers’  abilities  to 
accurately  estimate  the  depths  of  horizontally  oriented  fibrils  improved  significantly  with  the  use 
of  comb  shaped  stereo  cursors.  However,  some  observers  still  could  not  make  accurate  depth 
measurements  of  fibrils  in  this  orientation.  This  may  relate  to  different  aptitudes  for  stereoscopic 
visualization. 

(D)  Effects  of  Stereo  Shift  Angle,  Geometric  Magnification,  and  Display  Zoom  on  Depth 

Measurements  in  Digital  Stereomammograms 

We  performed  a  study  to  investigate  the  effects  of  stereo  shift  angle,  geometric 
magnification,  and  display  zoom  on  the  accuracy  of  depth  measurements  made  with  a  virtual  3D 
cursor  [Reportable  Outcomes,  Journal  Articles  #2].  A  phantom  containing  50  low  contrast  fibrils 
at  depths  ranging  from  1  to  11  mm  was  imaged  with  the  GE  full-field  digital  mammography 
system.  Left-  and  right-eye  images  were  generated  at  stereo  shift  angles  of  ±3°  and  ±6°,  using 
either  contact  or  1.8X  geometric  magnification  geometry.  The  images  were  viewed  on  the  high- 
resolution  Barco-Metheus  stereoscopic  display  system  in  normal  and  2X  zoom  mode.  Observers 
viewed  the  images  with  stereo  glasses  and  adjusted  the  depth  of  a  cross-shaped  virtual  cursor  to 
best  match  the  perceived  depth  of  each  fibril.  The  results  for  two  trained  observers  with  excellent 
stereo  acuity  were  nearly  identical  when  viewing  the  same  images.  The  average  root-mean- 
square  errors  for  the  two  observers  were  1.2  mm  (±3°  stereo  shift,  contact,  no  zoom),  1.3  mm 
(±3°  stereo  shift,  contact,  2X  zoom),  0.8  mm  (±6°  stereo  shift,  contact,  no  zoom),  0.6  mm  (±6° 
stereo  shift,  contact,  2X  zoom),  0.8  mm  (+3°  stereo  shift,  magnification,  no  zoom),  0.7  mm  (±3° 
stereo  shift,  magnification,  2X  zoom),  and  0.2  mm  (±6°  stereo  shift,  magnification,  no  zoom). 
One  observer  repeated  the  entire  study  for  2  additional  fibril  phantom  configurations. 
Combining  all  of  the  results,  we  found  that  for  the  contact  geometry  increasing  the  stereo  shift 
angle  from  ±3°  to  ±6°  improved  the  depth  measurement  accuracy  by  factors  of  about  1.2  to  4.0. 
Zooming  did  not  provide  observable  improvement  in  the  depth  measurement  accuracy; 
sometimes  having  no  effect,  sometimes  improving  the  accuracy,  and  other  times  reducing  the 
accuracy,  with  no  general  trends.  The  effect  of  zooming  is  likely  within  experimental  errors. 
However,  the  stereo  effect  was  more  readily  visualized  in  the  zoom  mode.  Geometric 
magnification  improved  the  depth  measurement  accuracy.  The  best  accuracy  among  all  cases 
was  about  0.2  mm,  obtained  with  geometric  magnification  using  a  stereo  angle  of  ±6°.  This  is 
the  mode  we  recommend  for  obtaining  accurate  depth  measurements  with  virtual  cursors  in 
stereomammograms . 

(E)  Effects  of  Stereoscopic  Imaging  Technique  on  Depth  Discrimination 

Stereoscopic  mammography  can  potentially  improve  detection  of  breast  cancer  by 
reducing  the  effects  of  overlapping  tissues  and  providing  3-dimensional  information  about  a 
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lesion.  We  evaluated  the  effects  of  imaging  parameters  on  depth  discrimination  of 
mammographic  features  [Reportable  Outcomes,  Conference  Proceedings  #1].  A  breast  biopsy 
unit  was  used  for  digital  image  acquisition.  A  modular  phantom  containing  25  pairs  of  crossing 
vertical  and  horizontal  fibrils  with  five  different  depth  separations  was  designed.  The  phantom 
was  sandwiched  in  the  middle  of  4  cm  BR-12  material  to  simulate  the  scatter  condition  for  an 
average  breast.  Stereoscopic  image  pairs  of  three  different  phantom  configurations  were 
acquired  at  ±2.5°  and  ±5°  stereo-angles  and  at  three  different  exposure  levels  with  the  Fischer 
Biopsy  unit.  The  images  were  displayed  on  the  Barco-Metheus  Stereo  workstation  and  viewed 
with  LCD  stereo  glasses.  Nine  observers  visually  judged  if  the  vertical  fibril  in  each  pair  of 
crossing  fibrils  was  in  front  of  or  behind  the  horizontal  fibril.  It  was  found  that  for  viewing 
fibrils,  which  simulated  spiculations  or  thin  fibrous  structures  in  mammographic  images,  the 
accuracy  of  depth  discrimination  increased  with  increasing  exposure  and  stereo-angle  in  the 
range  studied.  However,  many  observers  found  it  difficult  to  merge  the  left-eye  and  right-eye 
images  to  achieve  stereovision  when  the  images  were  acquired  with  a  large  stereo-angle. 

(F)  Effects  of  Magnification  and  Zooming  on  Depth  Perception  in  Digital 

Stereomammography:  An  Observer  Performance  Study 

We  investigated  the  effects  of  magnification  and  zooming  on  depth  perception 
[Reportable  Outcomes,  Conference  Proceedings  #3  and  Journal  Articles  #3].  A  modular  phantom 
was  designed  which  contained  six  layers  of  1-mm-thick  Lexan  plates,  each  spaced  1  mm  apart. 
Eight  to  nine  small,  thin  nylon  fibrils  were  pasted  on  each  plate  in  horizontal  or  vertical 
orientations  such  that  they  formed  25  crossing  fibril  pairs  in  a  projected  image.  The  depth 
separation  between  each  fibril  pair  ranged  from  2  to  10  mm.  A  change  in  the  order  of  the  Lexan 
plates  changed  the  depth  separation  of  the  fibril  pairs.  Stereoscopic  image  pairs  of  the  phantom 
were  acquired  with  a  GE  full-field  digital  mammography  system.  Three  different  phantom 
configurations  were  imaged  using  techniques  of  30  kVp,  Rh/Rh,  ±3°  stereo  shift  angle,  contact 
and  1.8X  magnification  geometry,  and  4  to  63  mAs  exposure  range.  The  images  were  displayed 
on  the  Barco-Metheus  workstation  and  viewed  with  LCD  stereo  glasses.  Five  observers 
participated  in  the  study.  Each  observer  visually  judged  whether  the  vertical  fibril  was  in  front  of 
or  behind  the  horizontal  fibril  in  each  fibril  pair.  It  was  found  that  the  accuracy  of  depth 
discrimination  increased  with  increasing  fibril  depth  separation  and  x-ray  exposure.  The  accuracy 
was  not  improved  by  electronic  display  zooming  of  the  contact  stereo  images  by  2X.  Under 
conditions  of  high  noise  (low  mAs)  and  small  depth  separation  between  the  fibrils,  the  observers’ 
depth  discrimination  ability  was  significantly  better  in  stereo  images  acquired  with  geometric 
magnification  than  in  images  acquired  with  a  contact  technique  and  displayed  with  or  without 
zooming.  A  2-mm  depth  discrimination  was  achieved  with  over  60%  accuracy  on  contact 
images  with  and  without  zooming,  and  with  over  90%  accuracy  on  magnification  images.  This 
study  indicates  that  stereoscopic  imaging,  especially  with  magnification,  may  be  useful  for 
visualizing  the  spatial  distribution  of  microcalcifications  in  a  cluster  and  for  differentiating 
overlapping  tissues  from  masses  on  mammograms. 

(G)  Collection  of  Stereoscopic  Images  of  Biopsied  Breast  Tissue  Specimens 

We  collected  a  data  set  of  stereoscopic  images  of  breast  biopsy  tissue  specimens  for  an 
observer  study.  A  total  of  179  samples  were  imaged  in  two  views  with  stereo  imaging  techniques. 
Therefore,  a  total  of  716  images  (179  samples  X  2  images  per  stereo  pair  X  2  views  per  sample) 
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were  taken  with  the  GE  full  field  digital  mammography  system.  Table  I  shows  the  different  lesion 
types  in  our  data  set.  Of  these,  images  of  21  samples  were  excluded  from  the  observer  study  for 
various  reasons.  The  most  frequent  problem  was  that  the  tissue  sample  was  not  shifted  properly 
between  the  left  and  right  positions  during  image  acquisition  so  that  the  two  left-eye  and  right-eye 
images  could  not  be  merged  stereoscopically.  A  few  of  the  samples  did  not  contain  the  lesion  of 
interest  or  were  too  fragmented.  Therefore,  a  total  of  158  samples,  63  malignant  and  95  benign 
(Table  II),  were  used  in  the  observer  experiment. 


Table  I.  Breast  biopsy  tissue  samples  imaged  by  the  stereomammographic  technique  for  the 
project. 


Lesion  Type 

Mass 

Microcalcifications 

Mass  & 

Microcalcifications 

Total 

Malignant 

37 

25 

5 

67 

Benign 

53 

52 

7 

112 

Table  n.  Breast  biopsy  tissue  samples  imaged  by  the  stereomammographic  technique  and  used 
for  the  observer  experiment. 


Lesion  Type 

Mass 

Microcalcifications 

Mass  & 

Microcalcifications 

Total 

Malignant 

35 

23 

5 

63 

Benign 

42 

47 

6 

95 

(H)  ROC  Study  Comparing  Radiologists’  Performances  in  Evaluating  Breast  Lesions  on 

Stereoscopic  and  Single-Projection  Digital  Specimen  Mammograms 

We  are  evaluating  the  effects  of  stereoscopic  imaging  on  the  interpretation  of 
mammographic  lesions.  In  this  investigation,  we  are  conducting  an  observer  receiver  operating 
characteristic  (ROC)  study  to  compare  radiologists’  performances  in  characterizing  breast  lesions 
in  biopsy  tissue  specimens  from  stereo  and  monoscopic  (single-projection)  digital  mammograms. 
Stereo  and  single-projection  images  of  the  158  tissue  specimens  described  above  (Table  II)  were 
acquired  with  the  GE  2000D  digital  mammography  system  in  our  department.  The  images  are 
displayed  on  the  DOME-MegaScan  stereo  display  workstation  and  viewed  with  LCD  glasses.  A 
graphical  user  interface  was  developed  that  allows  the  user  to  adjust  the  image  display 
parameters  and  to  record  the  Breast  Imaging  Reporting  and  Data  System  (BI-RADS)  assessment 
and  confidence  ratings  on  the  presence  of  microcalcifications  and  masses,  margin  clearance,  and 
likelihood  of  malignancy.  A  preliminary  study  was  conducted  with  five  MQSA  radiologists 
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reading  the  breast  lesions  in  seven  sessions.  The  stereo  display  mode  and  the  monoscopic  display 
mode  of  the  same  specimen  were  viewed  independently  in  different  sessions  and  in  random 
orders.  This  minimized  the  potential  memory  effects  such  that  the  observer  would  be  unlikely  to 
remember  the  information  that  he/she  had  seen  on  the  same  specimens  displayed  in  different 
modes.  The  observer  performances  in  terms  of  the  area  under  the  ROC  curve,  AZj  are  shown  in 
Table  HI.  For  the  BI-RADS  assessment,  the  viewing  of  stereo  images  resulted  in  an 
improvement  in  the  Az  for  4  out  of  the  7  readings.  For  the  estimation  of  the  likelihood  of 
malignancy,  3  of  the  7  readings  showed  an  improvement  in  the  Az,  2  were  reduced,  and  the  other 
two  were  comparable.  The  differences  did  not  reach  statistical  significance  using  the  Student’s 
paired  two-tailed  t-test.  One  of  the  observers  provided  a  very  low  Az  (near  a  chance  decision  of 
Az  =0.5)  with  the  stereo  images.  Although  this  observer  has  passed  a  standard  stereo  vision 
acuity  test,  it  appears  that  the  observer  may  have  some  difficulty  in  interpreting  clinical  image 
information  in  stereo  images.  These  equivocal  preliminary  results  may  indicate  that  the 
radiologists  are  used  to  reading  mammograms  in  monoscopic  views  so  that  they  are  unfamiliar 
with  image  features  in  3D.  In  order  to  interpret  3D  mammographic  features  of  lesions,  the 
radiologists  will  need  training  in  reading  stereo  images. 


Table  ID.  Results  of  a  preliminary  observer  performance  experiment  that  evaluated  radiologists’ 
classification  of  breast  lesions  in  monoscopic  (single-projection)  and  stereoscopic 
images  of  biopsied  tissue  specimens. 


BI-RADS  rating 

Likelihood  of  Malignancy  rating 

Reading  sets 

Az  (Mono) 

Az  (Stereo) 

Az  (Mono) 

Az  (Stereo) 

1 

0.734 

0.826 

0.759 

0.771 

2 

0.753 

0.704 

0.756 

0.687 

3 

0.745 

0.904 

0.754 

0.789 

4 

0.688 

0.737 

0.717 

0.739 

5 

0.774 

0.737 

0.778 

0.771 

6 

0.607 

0.551 

0.619 

0.557 

7 

0.704 

0.732 

0.725 

0.723 

In  view  of  the  potential  difficulty  of  observers  using  the  stereo  image  information 
independently,  we  have  decided  to  modify  the  experimental  design  of  the  observer  experiment. 
In  the  new  design,  the  observer  will  first  read  the  monoscopic  view  of  the  image  and  provide  the 
ratings  based  on  the  monoscopic  view  alone.  Immediately  after  reading  the  monoscopic  image, 
the  observer  will  be  presented  with  the  stereoscopic  view.  The  observer  can  then  change  his/her 
ratings  after  viewing  the  stereoscopic  image.  In  this  way,  the  stereoscopic  view  will  provide 
supplemental  information  in  addition  to  the  monoscopic  view  for  diagnosis  of  the  breast  lesions. 
The  combination  of  monoscopic  and  stereoscopic  viewing  will  more  likely  be  the  method  of 
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choice  in  clinical  interpretation  because  the  monoscopic  images  are  readily  available  in  a 
stereoscopic  display  and  the  additional  information,  if  any,  should  be  fully  utilized  by  the 
radiologists.  We  will  continue  the  observer  performance  experiment  and  present  the  results  in 
the  upcoming  AAPM  meeting  in  August,  2003  (Reportable  Outcomes,  Conference  Presentation 
#11). 

(I)  Pilot  Clinical  Study  of  Stereomammography 

We  have  acquired  digital  stereomammograms  of  7  patients,  with  IRB  approved  informed 
consent,  using  the  stereomammographic  imaging  technique  developed  in  this  project.  We  showed 
the  first  stereomammogram  acquired  with  our  technique  and  displayed  on  the  DOME-MegeScan 
stereo  display  workstation  in  last  year’s  report.  As  discussed  in  last  year’s  report,  this  pilot  study 
was  performed  as  an  adjunct  to  an  ongoing  pilot  clinical  trial  in  the  Breast  Care  Center  in  the 
University  of  Michigan  Health  System  that  uses  three-dimensional  (3D)  ultrasound  scanning  and 
mammography  to  monitor  the  response  of  breast  cancers  to  neoadjuvant  chemotherapy  treatment. 
We  plan  to  investigate  if  the  improved  visualization  of  structures  in  the  stereomammogram,  in 
comparison  to  a  regular  mammogram,  in  combination  with  3D  ultrasound  will  improve  the 
identification  of  tumor  response.  This  does  not  deviate  from  the  original  research  plan  because  the 
breast  cancer  patients  scheduled  for  chemotherapy  are  actually  a  subset  of  patients  who  has 
suspicious  breast  lesions.  The  preliminary  results  of  the  pilot  study  are  promising  in  that  the 
radiologists  are  impressed  with  the  additional  3D  information  seen  in  the  stereo  images.  Since  the 
number  of  patients  is  small  in  this  pilot  study,  we  cannot  draw  conclusions  about  the  significance 
of  the  study  results.  However,  this  new  direction  of  application  of  stereomammography  will  be 
pursued  in  continued  investigations  in  the  future. 
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(6)  Key  Research  Accomplishments 


•  Designed  and  built  a  3D  modular  phantom  for  study  of  depth  discrimination  with 
stereoscopic  imaging  and  study  of  accuracy  of  depth  measurement  with  3D  virtual  cursor  — 
(Task  1) 

•  Designed  and  built  stereoscopic  3D  breast  phantoms  with  embedded  test  objects  for  phantom 
studies  with  the  full  field  mammography  system  —  (Task  1  and  Task  5) 

•  Acquired  a  high-quality  stereo  image  display  from  Barco-Metheus.  Developed  software  on  a 
SUN  Microsystem  workstation  for  image  display,  windowing,  zooming,  panning,  and  virtual 
cursors,  etc,  on  the  stereo  display  for  performing  the  observer  experiments  to  optimize  the 
stereoscopic  imaging  techniques  —  (Task  2  and  Task  3) 

•  Acquired  a  state-of-the-art  high-resolution  stereo  image  display  workstation  from  DOME- 
MegaScan.  Developed  display  functions,  virtual  cursors,  and  graphical  user  interface  on  a  PC 
for  display  of  full  field  digital  stereomammograms  and  biopsied  breast  tissue  specimens  — 
(Task  2,  Task  4,  Task  5,  and  Task  6) 

•  Performed  observer  experiment  to  study  the  effects  of  stereoscopic  imaging  techniques  on 
depth  discrimination  in  digital  stereomammography  -  (Task  3) 

•  Performed  the  observer  experiment  to  study  the  effects  of  exposure,  stereo  shift, 
magnification  and  display  zoom  on  visual  depth  discrimination  in  digital 
stereomammography  —  (Task  3  and  Task  5) 

•  Developed  software  for  generating  3D  virtual  cursors  on  stereoscopic  display-  (3D  virtual 
cursor  and  quantitative  depth  measurement  were  not  in  the  SOW  but  are  related  to  Task  3, 
Task  4,  and  Task  5) 

•  Performed  observer  experiment  to  study  the  effects  of  3D  virtual  cursors  shape  on  depth 
measurements  in  digital  stereomammograms  —  (3D  virtual  cursor  and  quantitative  depth 
measurement  were  not  in  the  SOW  but  are  related  to  Task  3,  Task  4,  and  Task  5) 

•  Performed  observer  experiment  to  study  the  effects  of  stereo  shift,  magnification,  and  display 
zoom  on  the  accuracy  of  depth  measurements  in  digital  stereomammograms  using  3D  virtual 
cursors  —  (3D  virtual  cursor  and  quantitative  depth  measurement  were  not  in  the  SOW  but 
are  related  to  Task  3,  Task  4,  and  Task  5) 

•  Developed  a  stereoscopic  image  acquisition  technique  and  built  a  phantom  shift  device  for 
acquiring  stereoscopic  image  pairs  with  a  clinical  full  field  digital  mammography  system  — 
(This  technique  was  not  proposed  in  the  SOW  but  is  related  to  Task  3,  Task  4,  and  Task  5) 

•  Collected  a  large  database  of  stereoscopic  images  of  biopsied  breast  tissue  specimens  and 
developed  software  on  DOME-MegaScan  stereo  display  workstation  for  observer 
performance  study  —  (Task  4) 
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•  Performed  observer  study  to  evaluate  the  effects  of  stereoscopic  imaging  on  the  assessment 
of  the  likelihood  of  malignancy  and  margin  clearance  of  breast  lesions  using  biopsied  breast 
tissue  specimens  —  (Task  4) 

•  Collected  full  field  stereomammograms  from  informed  consent  patients  in  a  pilot  clinical 
study  (Task  6). 


(7)  Reportable  Outcomes 

As  a  result  of  the  support  by  the  BCRP  grant,  we  have  conducted  extensive  studies  in 

stereomammography  and  published  the  results.  The  publications  from  this  research  project  are 

listed  in  the  following. 

Journal  Articles: 

1.  Goodsitt  MM,  Chan  HP,  Hadjiiski  LM.  Stereomammography:  Evaluation  of  depth 
perception  using  a  virtual  3D  cursor.  Medical  Physics  2000;  27:  1305-1310. 

2.  Goodsitt  MM,  Chan  HP,  Darner  KL,  Hadjiiski  LM.  The  effects  of  stereo  shift  angle, 
geometric  magnification,  and  display  zoom  on  depth  measurements  in  digital 
stereomammography.  Medical  Physics  2002;  29:2725-2734. 

3.  Chan  HP,  Goodsitt  MM,  Hadjiiski  LM,  Bailey  JE,  Klein  K,  Darner  KL,  Sahiner  B.  Effects  of 
Magnification  and  Zooming  on  Depth  Perception  in  Digital  Stereomammography:  An 
Observer  Performance  Study.  Submitted  to  Physics  in  Medicine  and  Biology- 

Conference  Proceedings: 

1.  Chan  HP,  Goodsitt  MM,  Darner  KL,  Sullivan  JM,  Hadjiiski  LM,  Petrick  N,  Sahiner  B. 
Effects  of  stereoscopic  imaging  technique  on  depth  discrimination.  Presented  at  the  IWDM- 
2000.  Toronto,  Canada.  June  11-14,  2000.  In:  Digital  Mammography  IWDM  2000:  5th 
International  Workshop  on  Digital  Mammography.  Ed.  Yaffe  MJ.  (Medical  Physics 
Publishing,  Madison,  WI)  2001:  13-18. 

2.  Goodsitt  MM,  Chan  HP,  Sullivan  JM,  Darner  KL,  Hadjiiski  LM.  Evaluation  of  the  Effect  of 
Virtual  cursor  shape  on  depth  measurements  in  digital  stereomammograms.  Presented  at  the 
IWDM-2000.  Toronto,  Canada.  June  11-14,  2000.  In:  Digital  Mammography  IWDM  2000: 
5th  International  Workshop  on  Digital  Mammography.  Ed.  Yaffe  MJ.  (Medical  Physics 
Publishing,  Madison,  WI)  2001:  45-50. 

3.  Chan  HP,  Goodsitt  MM,  Hadjiiski  L,  Bailey  JE,  Klein  K,  Darner  KL,  Paramagul  C.  Digital 
stereomammography:  observer  performance  study  of  the  effects  of  magnification  and 
zooming  on  depth  perception.  Proc  SPIE  4682;  2002:  163-166. 
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1.  Goodsitt  MM,  Chan  HP,  Hadjiiski  LM.  Stereomammography:  Evaluation  of  depth 
perception  using  a  virtual  3-D  cursor.  Presented  at  the  85th  Scientific  Assembly  and  Annual 
Meeting  of  the  Radiological  Society  of  North  America,  Nov.  28-Dec.  3,  1999,  Chicago, 
Dlinois.  Radiology  1999;  213(P):  368. 

2.  Chan  HP,  Goodsitt  MM,  Darner  KL,  Sullivan  JM,  Hadjiiski  LM,  Petrick  N,  Sahiner  B. 
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11-14,2000. 

3.  Goodsitt  MM,  Chan  HP,  Sullivan  JM,  Darner  KL,  Hadjiiski  LM.  Evaluation  of  the  Effect  of 
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June  11-14,2000. 

4.  Chan  HP,  Goodsitt  MM.,  Sullivan  JM,  Darner  KL,  Hadjiiski  LM.  Depth  perception  in  digital 
stereoscopic  mammography.  Presented  at  the  Era  of  Hope  Meeting,  U.  S.  Army  Medical 
Research  and  Materiel  Command,  Department  of  Defense,  Breast  Cancer  Research  Program, 
Atlanta,  Georgia,  June  8-12,  2000. 

5.  Goodsitt  MM,  Chan  HP,  Sullivan  JM,  Darner  KL,  Hadjiiski  LM.  Development  of  virtual 
cursors  in  digital  stereomammography.  Presented  at  the  Chicago  2000-World  Congress  on 
Medical  Physics  and  Biomedical  Engineering.  Chicago,  Dlinois,  July  23-28,  2000. 
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Development  of  digital  stereo  imaging  technique  for  mammography.  Presented  at  the  Era  of 
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(8)  Conclusions 


•  Under  the  support  of  this  grant,  we  have  acquired  two  beta  high-resolution  stereo  display 
workstations  and  developed  software  and  graphic  user  interfaces  for  our  research  project.  We 
designed  and  built  a  modular  stereo  phantom  for  evaluation  of  the  effects  of  stereo  imaging 
techniques  on  depth  discrimination  and  absolute  depth  measurement.  We  also  designed  a  full 
breast  phantom  with  embedded  lesion-mimicking  objects  and  had  it  built  by  a  phantom 
manufacturer  to  evaluate  the  image  quality  of  stereoscopic  imaging. 

We  conducted  a  number  of  observer  performance  studies  to  optimize  the  imaging 
techniques  for  acquisition  of  stereoscopic  images.  This  included  the  determination  of  the 
stereoscopic  angle,  the  magnification  factor,  the  dose  requirements,  and  display  zooming.  A 
database  of  stereo  images  of  biopsied  tissue  specimens  was  collected.  The  database  was  used  in 
an  observer  performance  experiment  in  which  we  compared  the  accuracies  of  experienced 
radiologists  in  characterizing  lesions  and  in  determining  margin  clearance  evaluation  from 
readings  of  mono  and  stereo  images  of  the  biopsy  tissue  samples.  A  pilot  study  was  also 
performed  in  which  stereomammograms  of  patients  with  known  breast  cancer  were  acquired  and 
radiologists  evaluated  the  images  in  comparison  with  the  conventional  single-projection 
mammograms. 

In  the  course  of  the  research,  we  also  developed  a  new  idea  of  using  a  3D  virtual  cursor  for 
absolute  depth  measurement  for  objects  in  stereo  images.  A  series  of  observer  experiments  with 
phantom  images  was  performed  to  demonstrate  the  usefulness  and  evaluate  the  accuracy  of  depth 
measurement  using  3D  virtual  cursors. 

In  summary,  we  performed  an  extensive  investigation  of  the  dependence  of  the  accuracies 
of  depth  discrimination  and  depth  measurement  on  image  acquisition  techniques  in  digital 
stereomammography.  Software  tools  were  developed  for  two  high-resolution  stereo  display 
workstations  The  software  allows  manipulation  of  the  displayed  images  and  provides  3D  virtual 
cursors  for  the  measurement  of  the  depth  of  a  lesion  in  the  image.  Observer  experiments  were 
performed  to  evaluate  the  stereomammography  imaging  technique  using  phantoms  and  biopsied 
breast  tissue  samples.  A  pilot  study  of  comparing  full  field  digital  stereomammograms  with 
conventional  mammograms  was  conducted  and  the  image  quality  of  stereomammograms  was 
evaluated  by  radiologists.  Our  results  indicate  that  stereomammography  is  technologically 
feasible  and  it  is  a  promising  technique  that  will  provide  additional  3D  information  for  detection 
and  characterization  of  breast  lesions.  Further  studies  are  therefore  warranted  to  investigate 
whether  stereomammography  can  improve  the  sensitivity  of  mammography  for  breast  cancer 
detection,  especially  in  dense  breasts. 
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The  effects  of  stereo  shift  angle,  geometric  magnification  and  display  zoom 
on  depth  measurements  in  digital  stereomammography 

Mitchell  M.  Goodsitt,a)  Heang-Ping  Chan,  Katie  L.  Darner,  and  Lubomir  M.  Hadjiiski 

Department  of  Radiology,  University  of  Michigan,  Ann  Arbor,  Michigan  48109-0030 

(Received  23  January  2002;  accepted  for  publication  15  August  2002;  published  28  October  2002) 

We  are  developing  virtual  three-dimensional  (3-D)  cursors  for  measuring  depths  in  digital  stereo¬ 
mammograms.  We  performed  a  study  to  investigate  the  effects  of  stereo  shift  angle,  geometric 
magnification,  and  display  zoom  on  the  accuracy  of  depth  measurements  made  with  a  virtual  3-D 
cursor.  A  phantom  containing  50  low  contrast  fibrils  at  depths  ranging  from  1  to  1 1  mm  was  imaged 
with  a  full-field  digital  mammography  system.  Left-  and  right-eye  images  were  generated  at  stereo 
shift  angles  of  ±3°  and  ±6°,  using  either  contact  or  1.8 X  geometric  magnification  geometry.  The 
images  were  viewed  on  a  high-resolution  stereoscopic  display  system  in  normal  and  2X  zoom 
mode.  Observers  viewed  the  images  with  stereo  glasses  and  adjusted  the  depth  of  a  cross-shaped 
virtual  cursor  to  best  match  the  perceived  depth  of  each  fibril.  The  results  for  two  trained  observers 
with  excellent  stereo  acuity  were  nearly  identical  when  viewing  the  same  images.  The  average  root 
mean  square  errors  for  the  two  observers  were  1.2  mm  (—3°  contact,  no  zoom),  1.3  mm  (±3 
contact  zoom),  0.8  mm  (±6°  contact,  no  zoom),  0.6  mm  (±6°  contact,  zoom),  0.8  mm  (±3 
magnification,  no  zoom),  0.7  mm  (±3°  magnification,  zoom),  and  0.2  mm  (±6°  magnification,  no 
zoom).  One  observer  repeated  the  entire  study  for  two  additional  fibril  phantom  configurations. 

Combining  all  the  results,  we  found  that  for  the  contact  geometry  increasing  the  stereo  shift  angle 
from  ±3°  to  ±6°  improved  the  depth  measurement  accuracy  by  factors  of  about  1.2-4.0.  Zooming 
did  not  provide  observable  improvement  in  the  depth  measurement  accuracy;  sometimes  having  no 
effect,  sometimes  improving  the  accuracy,  and  other  times  reducing  the  accuracy,  with  no  general 
trends.  Its  effect  is  likely  within  experimental  errors.  However,  the  stereo  effect  was  more  readily 
visualized  in  the  zoom  mode.  Geometric  magnification  improved  the  depth  measurement  accuracy. 

The  best  accuracy  among  all  cases  was  about  0.2  mm,  obtained  with  geometric  magnification  using 
a  stereo  angle  of  ±6°.  This  is  the  mode  we  recommend  for  obtaining  accurate  depth  measurements 
with  virtual  cursors  in  stereomammograms.  ©  2002  American  Association  of  Physicists  in  Medi¬ 
cine.  [DOI:  10.1118/1.1517615] 

Key  words:  stereomammography,  stereoscopic,  virtual  cursor,  3-D  imaging 


I.  INTRODUCTION 

Tissue  superposition  makes  it  difficult  to  accurately  interpret 
conventional  mammograms.  Such  mammograms  are  ac¬ 
quired  using  a  single  projection  method  whereby  (ignoring 
scatter)  the  density  at  a  point  in  the  image  represents  the 
summation  of  the  attenuation  of  all  tissues  along  a  ray  ex¬ 
tending  from  the  x-ray  tube  focal  spot  to  that  point.  The 
superpositon  of  tissues  along  the  rays  decreases  image  con¬ 
trast  and  can  result  in  the  camouflaging  of  masses  and  mi¬ 
crocalcifications  within  dense  tissue.  It  can  also  lead  to  su¬ 
perimposed  structures  having  mass-like  appearances.  The 
superpositon  problem  can  be  reduced  or  eliminated 
by  generating  and  viewing  3-D  mammograms  via  multi- 
projection  techniques  such  as  stereoradiography,1-7  tomo¬ 
synthesis,8-10  and  computed  tomography.11,12 

We  have  been  investigating  digital  stereomammography. 
This  is  a  computerized  version  of  an  analog  technique  that 
was  first  described  by  Warren  in  1930.13  Both  the  new  and 
old  techniques  involve  taking  two  separate  mammograms, 
one  with  the  x-ray  tube  at  a  positive  angle  (e.g.,  +3°)  rela¬ 
tive  to  a  normal  to  the  detector  and  the  other  with  the  x-ray 
tube  at  an  equal  but  opposite  angle  (e.g.,  —3°)  about  the 


normal.  One  of  the  images  is  viewed  with  the  left  eye  and  the 
other  with  the  right  eye.  Our  brain  fuses  the  images  together 
to  create  a  3-D  effect.  The  old  technique  required  taking  two 
films  in  roughly  the  same  projection.  As  such,  it  had  several 
disadvantages,  including  at  least  twice  the  x-ray  dose,  film 
cost,  and  processing  time.  It  also  required  increased  proce¬ 
dure  time  and  radiologist  viewing  time.  Radiologists,  in  gen¬ 
eral,  eventually  decided  that  these  disadvantages  outweighed 
the  3-D  visualization  advantage,  and  film  stereomammogra¬ 
phy  was  discontinued.  Digital  mammography  eliminates  or 
reduces  most  of  these  advantages,  thereby  making  digital 
stereomammography  a  potentially  viable  technique.  In  con¬ 
trast  to  screen-film  systems,  which  have  sigmoid-shaped  re¬ 
sponse  curves,  digital  detectors  have  a  linear  response.  Thus, 
the  response  curve  of  the  digital  detector  does  not  degrade 
image  contrast  at  lower  doses,  and  it  may  be  possible  to 
utilize  half  the  normal  dose  for  each  digital  image.  The  two 
images  of  the  stereo  image  pair  will  be  integrated  by  the 
obsever’s  eye-brain  system  to  yield  about  the  same  signal- 
to-noise  ratio  as  in  a  single  image  taken  with  the  same  total 
dose.14  With  digital  systems,  image  processing  and  display 
are  almost  instantaneous.  Also,  the  method  of  examining  the 
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ences  have  a  0.6%  or  smaller  effect  on  the  accuracy  of  the 
results,  which  is  essentially  negligible  (e.g.,  0.6%  of  1.0  mm 
accuracy =0.006  mm). 

When  using  the  tube-shift  and  phantom-shift  methods,  it 
is  desirable  to  align  the  resulting  images  such  that  an  object 
(e.g.,  a  fibril)  in  contact  with  the  bottom  of  the  phantom  does 
not  shift.  By  doing  so,  all  depths  or  distances  of  objects  in 
the  phantom  will  be  measured  relative  to  the  back  surface  of 
the  phantom.  We  achieved  the  desired  zero  shift  by  placing  a 
fiducial  marker  on  the  top  surface  of  the  slider  on  which  the 
phantom  was  placed  and  digitally  translating  the  resulting 
left-  and  right-eye  images  so  that  the  fiducial  markers  coin¬ 
cided.  For  magnification  mammography,  especially  at  larger 
stereo  shift  angles,  the  phantom  shift  method  cannot  be  used 
because  only  a  portion  of  the  phantom  will  project  to  within 
the  field  of  view  of  the  detector  due  to  the  limited  size  of  the 
detector.  For  our  magnification  techniques,  we  employed  the 
phantom-shift  method  for  the  ±3°  stereo  image  acquisition 
and  the  tube-shift  method  for  the  ±6°  stereo  image  acquisi¬ 
tion.  All  images  in  this  study  were  obtained  using  a  tech¬ 
nique  of  30  kVp,  Rh  filter,  Rh  target,  63  mAs.  The  large 
(nominal  0.3  mm)  focal  spot  was  employed  for  the  contact 
images  and  the  small  (nominal  0.15  mm)  focal  spot  for  the 
(1.8X)  geometric  magnification  images.  The  scatter-rejection 
grid  was  removed  for  magnification  image  acquisition. 


C.  Stereo  image  display 

The  stereoscopic  display  system  that  was  employed  for 
this  study  consisted  of  a  Barco-Metheus  (Beaverton,  OR) 
model  1760S  stereo  graphics  board  in  a  SUN  Microsystems 
(Palo  Alto,  CA)  Ultra  10  computer.  The  Metheus  board  op¬ 
erates  in  a  page  flipping  stereoscopic  mode  whereby  the  left- 
and  right-eye  images  are  displayed  sequentially,  one  after  the 
other.  This  board  is  capable  of  displaying  1408X1408X8  bit 
progressive-scan  images  at  a  refresh  rate  of  114  Hz.  The 
images  in  our  study  were  displayed  on  a  21  in.  Barco  model 
521  monitor  and  viewed  with  Nu Vision  (Beaverton,  OR) 
LCD  stereoscopic  glasses.  We  employed  in-house  developed 
software  to  display,  pan,  zoom,  and  adjust  the  contrast  and 
brightness  of  the  images. 


D.  Virtual  cursor 

We  developed  software  to  generate  the  virtual  cursors  and 
display  their  x,  y,  and  z  positions.  The  3-D  nature  of  the 
cursor  is  achieved  by  introducing  offsets  in  the  horizontal 
positions  of  the  representations  of  the  cursor  in  the  left-  and 
right- eye  images.  The  z  coordinate  is  equal  to  the  offset. 
When  the  offset  is  0,  the  cursor  is  at  the  same  x,  y  position  in 
both  images,  and  it  appears  stereoscopically  to  be  at  the 
depth  of  the  monitor  screen.  As  the  horizontal  offset  between 
the  cursor  positions  is  increased  in  one  direction  (e.g.,  left), 
the  cursor  appears  to  move  closer  to  the  observer,  and  as  the 
offset  is  increased  in  the  opposite  direction  (e.g.,  right),  the 
cursor  appears  to  move  toward  or  into  the  monitor. 


E.  Z-coordinate  calibration 

The  z  coordinate  was  calibrated  by  imaging  thin  wires 
placed  on  the  steps  of  a  solid  acrylic  step  wedge  accurately 
milled  with  known  step  heights.  The  step  wedge  was  imaged 
with  the  GE  digital  mammography  system  using  the  same 
phantom  shift  or  x-ray  tube  shift  as  for  the  images  of  the 
fibril  phantoms  under  the  corresponding  imaging  conditions, 
and  using  the  fiducial  marker  alignment  technique  described 
previously.  The  thin  wires  that  were  employed  for  calibration 
were  oriented  perpendicular  to  the  tube  shift  direction.  The 
resulting  stereoscopic  images  were  viewed  without  the  stereo 
glasses  and  the  left-  and  right-eye  cursor  positions  were  ad¬ 
justed  to  overlay  the  left-  and  right-eye  images  of  the  wires 
on  the  steps.  The  z  coordinates  of  the  cursor  were  linearly  fit 
to  the  known  depths  of  the  wires  to  obtain  the  calibration 
line.  This  calibration  was  performed  for  each  of  the  image 
magnification/zoom  conditions  discussed  below.  While  this 
calibration  method  is  accurate  and  highly  reproducible,  it 
relies  on  the  ability  of  the  user  to  match  the  positions  of  the 
cursors  and  fibrils  in  the  image  and  is  therefore  subjective.  A 
future  improvement  of  the  calibration  method  would  entail 
developing  a  computer  program  to  determine  the  positions  of 
the  fibrils  (e.g.,  their  centers  of  masses). 

F.  True  fibril  depths 

Through  a  careful  examination  of  the  fibril  phantom,  we 
noticed  that  minor  warping  of  the  sandwiched  Lexan  plates 
could  cause  the  actual  depths  of  the  fibrils  to  differ  from  their 
nominal  1,  3,  5,  7,  9,  and  11  mm  values.  To  more  accurately 
determine  the  true  depths  of  the  fibrils  for  each  phantom 
layer  configuration,  we  applied  the  calibration  method  de¬ 
scribed  above  to  one  set  of  the  stereo  pair  images.  The  ±6° 
magnification  image  pair  was  selected  because  the  displace¬ 
ments  in  the  fibril  locations  between  the  left-  and  right-eye 
images  are  the  greatest  for  this  image  pair.  The  larger  dis¬ 
placement  results  in  greater  localization  accuracy  since  the 
limitation  of  approximately  ±1  pixel  uncertainty  in  place¬ 
ment  of  the  stereo  cursors  on  the  fibrils  in  the  images  will 
correspond  to  a  smaller  uncertainty  in  the  actual  depth.  A 
third  observer  who  was  different  from  the  two  who  partici¬ 
pated  in  the  observer  study  described  below  viewed,  without 
the  stereo  glasses,  the  ±6°  magnification  stereo  pair  images 
of  the  phantoms  in  the  three  multilayer  configurations  stud¬ 
ied  and  adjusted  the  left-  and  right-eye  cursor  components  to 
overlay  each  fibril.  The  measured  z  values  were  then  con¬ 
verted  to  true  depths  in  millimeters  using  the  calibration  lines 
derived  with  the  step  wedge  phantom.  In  performing  this 
procedure,  we  found  that  when  the  nominal  1  mm  depth 
fibrils  (i.e.,  those  that  were  a  distance  of  1  mm  from  the 
bottom  of  the  phantom)  were  viewed  without  the  glasses, 
they  were  too  close  to  each  other  for  the  accurate  positioning 
of  overlaying  cursors.  We  therefore  could  not  determine  their 
true  depths  and  only  analyzed  the  true  depths  of  the  fibrils  at 
the  nominal  3,  5,  7,  9,  and  11  mm  depths  in  the  phantoms. 
Hence,  the  results  in  this  paper  are  only  presented  at  those 
depths.  This  is  a  consequence  of  the  method  that  was  em¬ 
ployed  to  determine  the  true  depths  and  would  not  be  a  limi- 
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(a)  True  Depth  (mm) 


(b)  True  Depth  (mm) 

Fig.  3.  (a)  Calibration  lines  for  ±3°  stereo  shift  contact  and  ±6°  stereo  shift 
contact  acquisition;  (b)  calibration  lines  for  ±3°  stereo  shift  magnification 
and  ±6°  stereo  shift  magnification  acquisition. 

ometry  are  compared  in  part  (b).  For  the  2X-zoom  mode,  our 
cursor  software  effectively  incremented  the  z  values  in  steps 
of  0.5  per  pixel  shift  instead  of  steps  of  1  for  the  nonzoom 
mode.  Consequently,  the  calibration  lines  that  were  com¬ 
puted  in  the  2X-zoom  display  modes  were  nearly  identical  to 
those  in  the  nonzoom  modes  and  they  are  therefore  not 
shown  in  the  figures.  The  calibration  equations  for  the  con¬ 
version  of  the  measured  z  values  to  the  depths  (distances 
from  the  back  of  the  phantoms)  for  the  various  imaging  con¬ 
ditions  are  listed  in  Table  I,  below. 
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Table  I.  Calibration  equations  for  converting  measured  z  values  to  depths 
(distances  in  front  of  the  backside  of  the  phantom).  Note:  these  calibration 
equations  were  derived  by  linearly  fitting  the  data  acquired  from  the  step 
wedge  images.  Examples  of  the  lines  for  the  step  wedge  data  are  shown  in 
Fig.  1. 


Stereo  Shift 

Angle 

Geometry 

Display  zoom 

Equation 

±3  degrees 

Contact 

None 

Z+1.9 
Depth  (mm)  =  Qg5 

±3  degrees 

Contact 

2X 

Z+1.55 

Depth  (mm)  —  g25 

±6  degrees 

Contact 

None 

Z+1.5 

Depth  (mm)  = 

±6  degrees 

Contact 

2X 

Z+2.5 

Depty  (mm)  =  (  ?5 

±3  degrees 

Magnification 

None 

Z+2.9 

Depth  (mm)  =  3?5 

±3  degrees 

Magnification 

2X 

Z+2.6 

Depth  (mm)  =  35 

±6  degrees 

Magnification 

None 

Z+3.15 
Depth  (mm)  =  46gg 

Results  comparing  the  performances  of  the  two  observers 
for  the  various  stereo  angle,  geometric  magnification,  and 
display  zoom  combinations  of  the  experiment  are  summa¬ 
rized  in  Tables  II-IV.  Examples  of  plots  of  the  measured 
versus  true  depths  for  one  observer  for  each  of  the  imaging 
conditions  are  shown  in  Fig.  4.  Errors  in  the  depth  measure¬ 
ments  for  each  imaging  condition  for  the  one  observer  who 
viewed  images  in  two  additional  phantom  configurations  are 
fisted  in  Table  IV.  The  paired  f-test  results  for  the  observer 
who  measured  the  z  values  of  the  fibrils  in  the  phantom  in 
three  separate  phantom  layer  configurations  are  fisted  in 
Table  V.  (Note,  the  paired  f-test  results  for  the  other  observer 
who  made  measurements  of  the  fibrils  in  the  first  phantom 
configuration  were  very  similar  to  those  fisted  in  part  A  of 
this  table  and  are  therefore  not  shown.) 

The  reproducibility  of  the  observer’s  measurements  in  the 
same  image  read  twice  was  excellent.  For  the  40  fibrils  that 
were  analyzed  in  the  image,  35  of  the  measured  z  values 
were  the  same  for  both  readings,  and  the  remaining  5  z  val¬ 
ues  differed  by  ±1.  This  translates  to  a  rms  difference  in  the 
z  values  of  0.354  (i.e.,  ^5/40),  which  is  equal  to  0.21  mm. 


Table  II.  Linear  fit  parameters  for  measured  versus  true  depths  of  fibrils  for  two  observers  (values  for  observer 
1  are  indicated  by  subscript  1,  and  for  observer  2  by  subscript  2). 


3° 

3°  zoom 

6° 

6°  zoom 

3°  mag 

3°  mag  zoom 

6°  mag 

ri 

0.956 

0.949 

0.994 

0.996 

0.982 

0.978 

0.998 

r  2 

0.934 

0.921 

0.994 

0.996 

0.985 

0.981 

0.998 

interceptj 

0.669 

0.030 

-0.757 

-0.306 

-0.822 

-0.470 

-0.013 

intercept2 

1.379 

0.930 

-0.910 

-0.502 

-0.777 

-0.476 

-0.082 

slope! 

0.969 

1.041 

1.000 

0.978 

1.031 

1.007 

0.994 

sIope2 

0.961 

1.002 

1.037 

0.997 

1.049 

1.016 

1.004 

SEEj 

0.884 

1.036 

0.331 

0.263 

0.604 

0.656 

0.170 

see3 

1.103 

1.264 

0.329 

0.254 

0.560 

0.606 

0.174 
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Fig.  4.  Examples  of  measured  versus  true  depths  (distances  from  the  back  of  the  phantom)  for  observer  number  1.  (a)  Stereo  shift  angle  =  ±3°,  contact,  no 
zoom;  (b)  stereo  shift  angle  =  ±3°,  contact,  zoom=2;  (c)  stereo  shift  angle  =  ±6°,  contact,  no  zoom;  (d)  stereo  shift  angle  =±6°,  contact,  zoom- 2;  (e)  stereo 
shift  angle  =±3°,  magnification  mode,  no  zoom;  (f)  stereo  shift  angle  =±3°,  magnification  mode,  zoom-2;  (g)  stereo  shift  angle  -±6°,  magnification  mode, 
no  zoom. 
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fore  likely  caused  by  experimental  uncertainties  due  to  the 
many  factors  described  above.  Thus,  artificially  increasing 
the  displacement  between  objects  viewed  in  the  left-  and 
right-eye  stereo  pairs  through  zooming  the  display  does  not 
have  the  same  effect  as  increasing  the  displacement  via  in¬ 
creasing  the  stereo  shift  angle  or  increasing  the  geometric 
magnification.  The  stereo  effect  was  more  readily  visualized 
in  the  zoom  mode,  but  the  signal-to-noise  ratios  of  the  fibril 
images  were  basically  the  same  as  those  in  the  images  dis¬ 
played  without  zoom.  In  contrast,  the  acquisition  of  images 
with  geometric  magnification  actually  improves  the  signal- 
to-noise  ratio.18  The  2X  zoom  that  was  employed  in  this 
study  was  achieved  by  pixel  replication.  Results  may  be  dif¬ 
ferent  for  interpolative  zoom.  Finally,  the  use  of  greater 
zoom  factors  was  also  not  explored.  However,  based  on  the 
results  of  a  recently  published  study,  increasing  the  display 
zoom  factor  may  not  be  beneficial.19  In  that  study,  the  ob¬ 
servers’  stereoacuities  and  depth  perceptions  were  compared 
using  a  standard  Randot  stereotest  pattern,  with  and  without 
magnification  via  a  4X  optical  loupe  and  a  16X  microscope. 
The  researchers  found  that  stereo  acuity  and  depth  perception 
decreased  with  increasing  optical  magnification  of  the  pat¬ 
tern. 

The  paired  f-test  results  listed  in  Table  V  indicate  the  ma¬ 
jority  of  the  differences  between  the  depth  measurement  ac¬ 
curacies  obtained  with  the  ±3°  and  ±6°  stereo  shift  angles, 
magnification  and  contact  geometries,  and  normal  and  zoom 
displays  are  statistically  significant  (p< 0.05).  It  is  interesting 
to  note  that  there  was  little  consistency  between  the  catego¬ 
ries  of  the  small  number  of  insignificant  differences  (p 
>0.05)  for  the  images  created  with  the  three  different  phan¬ 
tom  configurations  (parts  A,  B,  and  C  of  Table  V).  The  only 
consistent  insignificant  result  was  that  in  two  of  the  three 
cases,  the  accuracies  for  the  ±3°  mag  and  ±3°  mag  zoom 
depth  measurements  were  not  statistically  significant.  The 
f-test  results  for  the  two  observers  were  quite  similar  for 
phantom  configuration  #1  (see  footnote  “a”  of  Table  V,  part 
A).  Increasing  the  number  of  observers  would  have  increased 
the  statistical  power  of  this  study;  however,  the  variability  in 
the  results  due  to  the  various  factors  described  above  would 
not  have  been  reduced.  Therefore  the  conclusions  would 
likely  be  the  same. 

The  best  accuracy  of  about  0.2  mm,  among  all  cases,  was 
obtained  with  geometric  magnification  using  a  stereo  angle 
of  ±6°.  Therefore,  this  is  the  mode  we  recommend  for  ob¬ 
taining  accurate  depth  measurements  with  virtual  cursors  in 
stereomammograms.  Conventional  stereoradiography  is  per¬ 
formed  in  contact  mode  using  a  stereo  shift  angle  of  ±3°. 
According  to  Christensen,20  this  angle  was  determined  em¬ 
pirically  “by  trial  and  error.”  The  angle  is  a  compromise 
between  the  improved  stereoscopic  effect  with  increasing 
angle,  the  increased  eye  strain  and  difficulty  in  fusing  the 
left-  and  right-eye  images,  especially  at  larger  stereo  angles, 
and  the  reduced  patient  coverage  at  larger  stereo  angles.  For 
our  particular  case,  the  increased  stereoscopic  effect  associ¬ 
ated  with  the  use  of  twice  the  conventional  stereo  angle  and 
the  use  of  ~1.8X  geometric  magnification  did  not  cause  un¬ 
due  eye  strain.  It  did  reduce  the  imaged  field  of  view  and  this 


geometry  could  not  be  used  for  imaging  an  entire  breast  un¬ 
less  a  larger-area  detector  was  employed.  Based  on  our  mea¬ 
surements  and  observations,  we  recommend  for  stereoscopic 
imaging  and  depth  measurements  within  an  entire  breast 
with  the  GE  full-field  digital  mammography  system,  that  a 
contact  geometry  be  employed  using  a  stereoshift  angle  of 
±6°  instead  of  the  conventional  ±3°.  The  overall  results  and 
recommendations  of  this  study  may  differ  for  detectors  hav¬ 
ing  different  pixel  sizes  and  noise  properties  and  for  displays 
with  different  noise  and  contrast.  A  further  investigation  of 
the  effects  of  these  factors  is  warranted. 

Finally,  the  depth  measurement  accuracies  of  the  two  ob¬ 
servers  in  this  study  (Table  HI)  were  almost  identical  (in 
nearly  all  cases  they  were  within  0.1  mm  of  each  other). 
Both  observers  had  excellent  stereo  acuity,  and  it  would  be 
expected  that  others  with  similar  stereo  acuity  could  achieve 
similar  results  after  a  period  of  training.  Our  previous  studies 
with  other  observers  have  shown  that  there  is  a  wide  range  of 
accuracies  for  depth  measurements,  especially  for  horizon¬ 
tally  oriented  objects.3  All  of  the  fibrils  in  this  study  had 
horizontal  and  vertical  components,  so  it  would  be  expected 
that  even  observers  who  have  difficulties  measuring  the 
depths  of  horizontally  oriented  objects  would  be  able  to  mea¬ 
sure  the  depths  of  the  diagonally  oriented  fibrils,  although 
their  accuracies  may  not  be  as  high.  Since  it  is  unlikely  that 
fibrous  tissues  or  spicules  from  masses  in  mammograms  are 
exactly  horizontal  to  the  stereo  shift  direction,  the  angulation 
would  enable  reasonably  accurate  measurements  in  clinical 
images.  However,  the  inhomogeneous  anatomical  back¬ 
ground  within  the  clinical  images  may  partially  obscure  the 
fibrils,  which  would  increase  the  difficulty  of  making  accu¬ 
rate  depth  measurements  with  the  stereo  cursor.  It  is  possible 
that  with  additional  training  and  the  use  of  depth  cues  (e.g., 
3-D  wire  boxes  placed  about  the  objects  of  interest,  or  3-D 
rulers  in  the  image)  in  clinical  images,  the  depth  measure¬ 
ment  accuracies  of  most  viewers  would  be  adequate.  The 
development  of  such  depth  cues  will  be  the  subject  of  our 
future  investigations. 

ACKNOWLEDGMENTS 

This  work  is  supported  by  U.S.  Army  Medical  Research 
and  Material  Command  Grants  No.  DAMD  17-98-1-8210 
and  No.  DAMD  17-99-1-9294.  The  content  of  this  publica¬ 
tion  does  not  necessarily  reflect  the  position  of  the  funding 
agency,  and  no  official  endorsement  of  any  equipment  and 
product  of  any  companies  mentioned  in  this  publication 
should  be  inferred. 

^Corresponding  author:  Department  of  Radiology,  University  of  Michigan 
Hospitals,  Room  B1  F510C,  1500  East  Medical  Center  Drive,  Ann  Arbor, 
Michigan  48109-0030.  Office  734-936-7474;  Fax:  734-936-7948;  Elec¬ 
tronic  mail:  goodsitt@umich.edu 

1 D.  M.  Chelberg,  J.  Hsu,  C.  G.  Babbs,  Z.  Pizlo,  and  E.  J.  Delp,  “Digital 
stereomammography,”  in  Proceedings  of  the  2nd  International  Workshop 
on  Digital  Mammography ,  Excepta  Medica  International  Congress  Series 
1069  (Elsevier  Science,  York,  England,  1994),  pp.  181-190. 

2  J.  Hsu,  D.  M.  Chelberg,  C.  F.  Babbs,  Z.  Pizlo,  and  E.  J.  Delp,  “Preclinical 
ROC  studies  of  digital  stereomammography,”  IEEE  Trans.  Med.  Imaging 
14,318-327  (1995). 


Medical  Physics,  Vol.  29,  No.  11,  November  2002 


Stereomammography:  Evaluation  of  depth  perception  using  a  virtual 
3D  cursor 

Mitchell  M.  Goodsitt,a)  Heang-Ping  Chan,  and  Lubomir  Hadjiiski 

Department  of  Radiology,  University  of  Michigan,  Ann  Arbor,  Michigan  48109-0030 
(Received  22  October  1999;  accepted  for  publication  28  March  2000) 

We  are  evaluating  the  usefulness  of  stereomammography  in  improving  breast  cancer  diagnosis.  One 
area  that  we  are  investigating  is  whether  the  improved  depth  perception  associated  with  stereomam¬ 
mography  might  be  significantly  enhanced  with  the  use  of  a  virtual  3D  cursor.  A  study  was 
performed  to  evaluate  the  accuracy  of  absolute  depth  measurements  made  in  stereomammograms 
with  such  a  cursor.  A  biopsy  unit  was  used  to  produce  digital  stereo  images  of  a  phantom  contain¬ 
ing  50  low  contrast  fibrils  (0.5  mm  diam  monofilaments)  at  depths  ranging  from  1  to  1 1  mm,  with 
a  minimum  spacing  of  2  mm.  Half  of  the  fibrils  were  oriented  perpendicular  (vertical)  and  half 
parallel  (horizontal)  to  the  stereo  shift  direction.  The  depth  and  orientation  of  each  fibril  were 
randomized,  and  the  horizontal  and  vertical  fibrils  crossed,  simulating  overlapping  structures  in  a 
breast  image.  Left  and  right  eye  images  were  generated  by  shifting  the  x-ray  tube  from  +2.5°  to 
—2.5°  relative  to  the  image  receptor.  Three  observers  viewed  these  images  on  a  computer  display 
with  stereo  glasses  and  adjusted  the  position  of  a  cross-shaped  virtual  cursor  to  best  match  the 
perceived  location  of  each  fibril.  The  jc,  y,  and  z  positions  of  the  cursor  were  indicated  on  the 
display.  The  z  (depth)  coordinate  was  separately  calibrated  using  known  positions  of  fibrils  in  the 
phantom.  The  observers  analyzed  images  of  two  configurations  of  the  phantom.  Thus,  each  ob¬ 
server  made  50  vertical  filament  depth  measurements  and  50  horizontal  filament  depth  measure¬ 
ments.  These  measurements  were  compared  with  the  true  depths.  The  correlation  coefficients  be¬ 
tween  the  measured  and  true  depths  of  the  vertically  oriented  fibrils  for  the  three  observers  were 
0.99,  0.97,  and  0.89  with  standard  errors  of  the  estimates  of  0.39  mm,  0.83  mm,  and  1.33  mm, 
respectively.  Corresponding  values  for  the  horizontally  oriented  fibrils  were  0.91,  0.28,  and  0.08, 
and  1.87  mm,  4.19  mm,  and  3.13  mm.  All  observers  could  estimate  the  absolute  depths  of  vertically 
oriented  objects  fairly  accurately  in  digital  stereomammograms;  however,  only  one  observer  was 
able  to  accurately  estimate  the  depths  of  horizontally  oriented  objects.  This  may  relate  to  different 
aptitudes  for  stereoscopic  visualization.  The  orientations  of  most  objects  in  actual  mammograms  are 
combinations  of  horizontal  and  vertical.  Further  studies  are  planned  to  evaluate  absolute  depth 
measurements  of  fibrils  oriented  at  various  intermediate  angles  and  of  objects  of  different  shapes. 

The  effects  of  the  shape  and  contrast  of  the  virtual  cursor  and  the  stereo  shift  angle  on  the  accuracy 
of  the  depth  measurements  will  also  be  investigated.  ©  2000  American  Association  of  Physicists 
in  Medicine .  [S0094-2405(00)0 1406-1] 

Key  words:  stereomammography,  stereoscopic,  virtual  cursor,  three-dimensional 


I.  INTRODUCTION 

Presently,  screening  x-ray  mammography  is  the  only  tech¬ 
nique  that  has  a  proven  capability  for  detecting  early  stage 
clinically  occult  cancers.1  Although  mammography  has  a 
high  sensitivity  for  detecting  breast  cancers,  studies  have 
shown  that  radiologists  do  not  detect  all  carcinomas  that  are 
visible  on  retrospective  analyses  of  the  mammograms.2-11 
These  missed  detections  are  often  a  result  of  the  very  subtle 
nature  of  the  mammographic  findings.  One  of  the  major  de¬ 
ficiencies  of  mammography  is  the  inability  to  discern  masses 
and  microcalcifications  hidden  in  dense  fibroglandular 
tissue.12  It  is  estimated  that  about  20%  of  the  breast  cancers 
in  dense  breasts  are  not  detected  by  mammography.9,11  Con¬ 
ventional  mammography  is  a  two-dimensional  projection  im¬ 
age  of  a  three-dimensional  structure.  As  a  result,  objects 
along  the  same  x-ray  beam  path  overlap  each  other.  The 
overlying  tissue  structures  often  obscure  the  visibility  of 


subtle  lesions  of  interest  in  the  mammogram.  The  camou¬ 
flaging  of  the  anatomical  structures  is  the  main  cause  of 
missed  diagnoses.  Overlapping  structures  can  also  project 
onto  the  image  plane  forming  shadows  that  appear  to  be 
lesions,  resulting  in  false  positive  findings.  Radiologists  ex¬ 
amine  two  or  more  projections  of  each  breast  to  improve 
their  ability  to  detect  lesions  and  to  assist  them  in  distin¬ 
guishing  between  true  lesions  and  overlapping  tissues.  How¬ 
ever,  standard  mammographic  techniques  are  not  always 
successful  in  distinguishing  true  lesions  from  overlapping 
tissues.  Digital  stereomammography  is  a  method  that  could 
potentially  solve  many  of  these  problems. 

Stereomammography  is  not  a  new  technique.  It  was  first 
described  in  1930. 13  Like  other  forms  of  stereoradiography  at 
that  time,  it  involved  taking  two  film  images,  a  left  eye  im¬ 
age  and  a  right  eye  image.  These  were  obtained  by  position¬ 
ing  the  x-ray  tube  at  a  certain  distance  to  the  left  and  to  the 
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Fig.  2.  (Top)  Left  and  right  eye  images  of  the  phantom  shown  in  Fig.  1 .  The 
image  pair  was  obtained  with  a  stereoscopic  angle  of  ±2.5°  about  the  cen¬ 
tral  axis.  The  fibril  pairs  with  the  smallest  spacing  of  2  mm  in  this  phantom 
can  be  identified  and  the  relative  depths  of  the  different  fibrils  can  also  be 
clearly  distinguished.  (Bottom  left)  Image  of  the  phantom  that  is  stored  in 
the  computer  frame  buffer.  This  image  is  synch-doubled  by  the  display 
processor  for  stereoscopic  viewing.  Synch-doubling  enables  viewing  of  the 
left-  and  right-eye  images  at  twice  the  nominal  refresh  rate  of  the  display 
monitor  for  reduced  flicker.  The  left-eye  image  is  stored  in  the  frame  buffer 
at  the  top,  and  the  right-eye  image  at  the  bottom.  An  additional  vertical 
synch  pulse  is  inserted  between  the  two  images  to  produce  the  two  separate 
images  shown  at  the  top  of  this  figure.  (Bottom  right)  Image  formed  by 
combining  the  left-  and  right-eye  images  into  one.  An  image  similar  to  this 
is  seen  when  one  views  the  display  without  the  stereoscopic  glasses,  and  is 
the  one  used  to  calibrate  the  virtual  cursor.  The  virtual  cursor  (not  shown 
above)  appears  as  two  cursors  (a  left-eye  cursor  and  a  right-eye  cursor) 
when  the  images  are  viewed  without  the  stereo  glasses,  and  the  horizontal 
separation  between  the  cursors  changes  as  the  cursor  depth  is  adjusted. 


Physics  of  Diagnostic  Radiology  ,14  early  radiologists  learned 
by  “trial  and  error  that  a  tube  shift  equal  to  10%  of  the 
target-film  distance  produced  satisfactory  results.”14  This 
tube  shift  is  equal  to  a  total  stereo-shift  angle  of  about  6° 
(e.g.,  +3°  and  —3°  relative  to  a  line  perpendicular  to  the 
image  receptor.)  In  general,  larger  tube  shifts  produce  im¬ 
proved  depth  perception,  but  beyond  a  certain  limit,  this  is 
achieved  at  the  expense  of  increased  observer  fatigue26  and 
decreased  stereo  field  of  view.  The  angle  scale  on  the  Fischer 
unit  is  marked  in  5°  increments,  and  our  preliminary  inves¬ 
tigations  with  the  Fischer  digital  system  indicated  a  stereo 
shift  of  +2.5°  to  —2.5°  produced  images  that  appeared  to 
have  adequate  depth  discrimination  without  producing  undue 
eyestrain.  This  stereo  angle  was  therefore  used  for  image 
acquisition  in  this  study.  It  corresponds  with  a  total  stereo 
shift  of  about  9%  (5.94  cm)  for  the  68  cm  source-to-image 
distance  of  the  Fischer  system.  Future  studies  will  be  per¬ 
formed  to  determine  the  optimal  angle  for  accurate  depth 
perception  with  acceptable  eyestrain.  The  Fischer  unit  has  a 
fiber  optic-coupled  CCD  detector  that  produces  1024X1024 
X  12-bit  images.  The  images  can  be  stored  in  1024X1024 
X  8-bit  TIFF  format  or  transmitted  to  a  DICOM  server.  We 
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Table  I.  Linear  regression  results  for  measured  vs  true  depths  in  phantom 
images.  (A)  Vertically  oriented  fibrils.  (B)  Horizontally  oriented  fibrils. 


Reader 

Image 

Slope 

Intercept 

r- value 

SEE  (mm) 

(A) 

A 

1 

1.025 

-0.56 

0.992 

0.39 

A 

2 

1.017 

-0.56 

0.994 

0.38 

Average  A 

0.993 

0.39 

B 

1 

0.845 

-0.65 

0.887 

1.33 

B 

2 

0.868 

-0.61 

0.891 

1.32 

Average  B 

0.889 

1.33 

C 

1 

1.087 

-1.62 

0.963 

0.92 

C 

2 

0.955 

0.00 

0.968 

0.74 

Average  C 

0.966 

0.83 

Overall 

average 

(B) 

0.966 

-0.67 

0.949 

0.85 

A 

1 

1.129 

-3.04 

0.947 

1.24 

A 

2 

1.135 

-4.66 

0.871 

2.50 

Average  A 

0.909 

1.87 

B 

1 

0.003 

-5.57 

0.004 

2.55 

B 

2 

0.176 

-7.52 

0.154 

3.71 

Average  B 

0.079 

3.13 

C 

1 

0.189 

-3.70 

0.135 

4.54 

C 

2 

0.558 

-4.96 

0.431 

3.83 

Average  C 

0.283 

4.19 

Overall 

average 

0.532 

-4.91 

0.424 

3.06 

employed  the  TIFF  formatted  images  in  this  study.  Since  no 
contrast  enhancement  was  performed  on  the  displayed  im¬ 
ages  in  the  observer  study,  it  is  unlikely  that  a  bit  depth 
greater  than  8  bits  could  have  been  perceived  in  the  dis¬ 
played  images.  Therefore,  it  is  unlikely  that  compression  to  8 
bits  influenced  our  results. 

C.  Stereoscopic  viewer  and  virtual  cursor 

The  images  were  displayed  on  a  personal  computer  using 
a  Model  SS-03  Stereo  Display  Processor  from  Neotek,  Inc. 
(Pittsburgh,  PA).  We  used  Neotek’s  Composer  software  to 
format  the  images  and  their  optional  Presenter  software  to 
display  the  images  along  with  a  virtual  cursor.  The  Presenter 
software  also  generates  a  display  of  the  x,  y,  and  z-positions 
of  the  virtual  cursor.  The  Neotek  system  produces  stereo 
images  via  a  method  termed  “synch-doubling.”  In  this 
method,  the  left  eye  image  is  stored  above  the  right  eye 
image  in  the  video  graphics  board  (see  Fig.  2),  and  an  addi¬ 
tional  vertical  synch  pulse  is  inserted  between  the  two  im¬ 
ages  in  the  video  signal  coming  from  the  computer.  This 
synch-doubling  causes  the  images  to  be  displayed  fully  on 
the  monitor  at  twice  the  normal  refresh  rate  for  reduced 
flicker  (i.e.,  if  the  board  is  run  at  a  60  Hz  refresh  rate,  the 
images  are  displayed  at  120  Hz).  The  graphics  board  was 
operated  in  the  1024  (horizontal)  X  768  (vertical)  resolution 
mode  recommended  by  Neotek.  The  Neotek  Composer  soft¬ 
ware  downsized  the  1024X1024  images  to  fit  two  images 
(the  left  on  top  of  the  right)  within  this  resolution.  That  is,  it 
converted  the  left  and  right  eye  images  to  each  be  about 


Medical  Physics,  Vol.  27,  No.  6,  June  2000 


1309 


Goodsitt,  Chan,  and  Hadjiiski:  Stereomammography 


Table  II.  Root  mean  square  (RMS)  errors  of  measured  depths  of  fibrils.3 
(A)  Vertically  oriented  fibrils.  (B)  Horizontally  oriented  fibrils. 


Reader 

Image 

RMS  error  (mm) 

(A) 

A 

1 

0.59 

A 

2 

0.62 

B 

1 

1.91 

B 

2 

1.78 

C 

1 

1.53 

C 

2 

0.75 

Overall  average 

1.20 

(B) 

A 

1 

2.70 

A 

2 

4.76 

B 

1 

11.36 

B 

2 

12.56 

C 

1 

9.30 

C 

2 

8.24 

Overall  Average 

8.15 

aRMS  error  =  j(true  depth; 

—  measured  depth,)  2/25. 

rate  to  within  2  mm.  This  is  consistent  with  relative  stereo¬ 
scopic  studies  performed  by  Doi  and  Duda26  and  Higashida 
et  al15  and  absolute  stereoscopic  studies  performed  by  Fen- 
cil  etai16  Doi  and  Duda  and  Higashida  et  al  investigated 
observers’  abilities  to  distinguish  (as  opposed  to  measure) 
the  separation  of  objects  that  were  superimposed  on  step- 
wedge  phantoms.  In  Doi  and  Duda’s  study,26  the  objects 
were  0.2  mm  diam  aluminum  wires.  A  matrix  of  “plus” 
objects  were  formed  by  placing  horizontally  and  vertically 
oriented  pieces  of  wire  at  the  bottom  of  the  stepwedge,  with 
their  counterparts  located  directly  above  on  the  step  of 
known  thickness  (e.g.,  horizontal  wire  on  step  if  bottom  wire 
is  vertical).  The  “plus”  objects  were  imaged  stereoscopi- 
cally  using  a  geometric  magnification  factor  of  2  and  x-ray 
focal  spot  shifts  of  1.25%,  2.5%,  and  5%  of  the  focus-to-film 
distance.  These  investigators  found  that  observers  could  cor¬ 
rectly  identify  1  mm  separations  between  two  aluminum 
wires  80%  of  the  time  for  the  5%  tube  shift  and  between  60 
and  70%  for  the  other  tube  shifts.  In  Hagashida  et  al' s 
study,15  a  similar  phantom  was  used.  Teflon  tube  objects 
filled  with  contrast  media  were  arranged  on  the  stepwedge  to 
form  cross  (or  “X”)  shaped  objects.  They  employed  a  geo¬ 
metric  magnification  factor  of  1.1  and  the  x-ray  focal  spot 
shift  for  stereoscopic  imaging  was  6.5%  of  the  focus-to- 
image  intensifier  distance.  They  found  that  observers  could 
correctly  identify  1.6  mm  separations  between  1  mm  diam¬ 
eter  tubes  containing  25%  iodine  contrast  more  than  80%  of 
the  time. 

Our  study  and  results  can  be  distinguished  from  those  of 
Doi  and  Duda26  and  Higashida  et  al15  because  we  investi¬ 
gated  absolute  rather  than  relative  stereoscopic  measure¬ 
ments  and  because  we  analyzed  horizontally  and  vertically 
oriented  objects  separately.  With  respect  to  absolute  mea¬ 
surements,  Fencil  et  al}6  imaged  a  box  phantom  containing 
aluminum  wires  that  simulated  blood  vessels  at  different 
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angles.  Fencil  et  al.  employed  an  automated  cross¬ 
correlation  technique  to  determine  the  position  of  a  wire 
(vessel)  segment  in  the  second  image  of  a  stereoscopic  pan- 
after  it  was  selected  in  the  first  image.  They  obtained  an 
average  calculated  distance  error  of  approximately  ±2  mm, 
which  is  similar  to  our  error  for  vertically  oriented  fibrils  and 
the  errors  in  the  studies  of  Doi  and  Duda  and  Higashida  et  al. 
that  are  cited  above.  Our  technique  is  easier  to  implement 
than  Fencil  et  aV  s  but  more  observer  dependent,  as  the  ob¬ 
server  effectively  judges  the  correlation  between  the  cursor 
and  the  fibrils  in  both  images  of  the  stereoscopic  pair. 

The  fact  that  the  observers  in  our  study  did  worse  at  mea¬ 
suring  the  depths  of  horizontally  as  opposed  to  vertically 
oriented  fibrils  is  not  surprising  since  the  image  discrepancy 
and  hence  the  stereoscopic  effect  is  less  for  the  horizontal 
objects  (i.e.,  there  is  considerable  overlap  between  corre¬ 
sponding  horizontally  oriented  objects  in  the  stereo  pairs, 
and  the  shifts  in  positions  are  not  as  apparent).14  There  ap¬ 
pears  to  be  a  larger  difference  in  the  performance  among  the 
observers  for  the  horizontally  oriented  fibrils,  with  one  ob¬ 
server  performing  very  well  and  the  other  two  very  poorly. 
This  may  be  related  to  different  aptitudes  for  stereoscopic 
visualization. 

The  orientations  of  most  objects  in  actual  mammograms 
are  combinations  of  horizontal  and  vertical.  Further  studies 
are  planned  to  evaluate  absolute  depth  measurements  of 
fibrils  oriented  at  various  intermediate  angles  and  of  objects 
of  different  shapes.  The  effects  of  the  shape  and  contrast  of 
the  virtual  cursor  and  of  the  stereo  shift  angle  on  the  accu¬ 
racy  of  the  depth  measurements  will  also  be  investigated. 
Finally,  the  cursors  will  be  applied  to  digital  stereomammo¬ 
grams  of  breast  biopsy  samples  to  determine  their  applicabil¬ 
ity  in  estimating  lesion  depths  and  dimensions  and  in  provid¬ 
ing  additional  depth  cues  for  improved  stereoscopic  image 
interpretation. 
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ABSTRACT 


We  are  evaluating  the  application  of  stereoscopic  imaging  to  digital 
mammography.  In  the  current  study,  we  investigated  the  effects  of  magnification  and 
zooming  on  depth  perception.  A  modular  phantom  was  designed  which  contained  six 
layers  of  1-mm-thick  Lexan  plates,  each  spaced  1  mm  apart.  Eight  to  nine  small,  thin 
nylon  fibrils  were  pasted  on  each  plate  in  horizontal  or  vertical  orientations  such  that 
they  formed  25  crossing  fibril  pairs  in  a  projected  image.  The  depth  separation 
between  each  fibril  pair  ranged  from  2  to  10  mm.  A  change  in  the  order  of  the  Lexan 
plates  changed  the  depth  separation  of  the  two  fibrils  in  a  pair.  Stereoscopic  image 
pairs  of  the  phantom  were  acquired  with  a  GE  full-field  digital  mammography  system. 
Three  different  phantom  configurations  were  imaged.  All  images  were  obtained  using 
a  Rh  target/Rh  filter  spectrum  at  30  kVp  tube  potential  and  a  ±3°  stereo  shift  angle. 
Images  were  acquired  in  both  contact  and  1.8X  magnification  geometry  and  an 
exposure  range  of  4  to  63  mAs  was  employed.  The  images  were  displayed  on  a  Barco 
monitor  driven  by  a  Metheus  stereo  graphics  board  and  viewed  with  LCD  stereo 
glasses.  Five  observers  participated  in  the  study.  Each  observer  visually  judged 
whether  the  vertical  fibril  was  in  front  of  or  behind  the  horizontal  fibril  in  each  fibril 
pair.  It  was  found  that  the  accuracy  of  depth  discrimination  increased  with  increasing 
fibril  depth  separation  and  x-ray  exposure.  The  accuracy  was  not  improved  by 
electronic  display  zooming  of  the  contact  stereo  images  by  2X.  Under  conditions  of 
high  noise  (low  mAs)  and  small  depth  separation  between  the  fibrils,  the  observers’ 
depth  discrimination  ability  was  significantly  better  in  stereo  images  acquired  with 
geometric  magnification  than  in  images  acquired  with  a  contact  technique  and 
displayed  with  or  without  zooming.  Under  our  experimental  conditions,  a  2-mm  depth 
discrimination  was  achieved  with  over  60%  accuracy  on  contact  images  with  and 
without  zooming,  and  with  over  90%  accuracy  on  magnification  images.  This  study 
indicates  that  stereoscopic  imaging,  especially  with  magnification,  may  be  useful  for 
visualizing  the  spatial  distribution  of  microcalcifications  in  a  cluster  and  for 
differentiating  overlapping  tissues  from  masses  on  mammograms. 
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1.  INTRODUCTION 


At  present,  x-ray  mammography  is  the  only  diagnostic  procedure  with  a  proven 
capability  for  detecting  early  stage,  clinically  occult  breast  cancers  (Seidman  et  al, 
1987).  Although  mammography  has  a  high  sensitivity  for  detection  of  breast  cancers 
when  compared  to  other  diagnostic  modalities,  studies  indicate  that  radiologists  do  not 
detect  all  carcinomas  that  are  visible  on  retrospective  analyses  of  the  images  (Wallis  et  al, 
1991;  Bird  et  al,  1992;  Harvey  et  al,  1993;  Beam  et  al,  1996).  These  missed  detections 
are  often  a  result  of  the  very  subtle  nature  of  the  radiographic  findings.  However,  one  of 
the  major  deficiencies  of  mammography  is  its  inability  to  discern  lesions  hidden  behind 
dense  fibroglandular  tissues  (Jackson  et  al,  1993).  It  is  estimated  that  about  20%  of  the 
breast  cancers  in  dense  breasts  are  not  detected  by  mammography  (Wallis  et  al,  1991; 
Bird  et  al,  1992).  It  is  therefore  important  to  improve  the  sensitivity  of  mammography  in 
imaging  dense  breasts.  With  the  advent  of  high  resolution  digital  detectors,  new  breast 
imaging  techniques  such  as  stereomammography  (Goodsitt  et  al,  2000;  Chan  et  al,  2001; 
Getty  et  al,  2001;  Goodsitt  et  al,  2002;  Maidment  et  al,  2003),  digital  tomosynthesis 
(Niklason  et  al,  1997;  Suryanarayanan  et  al,  2000),  and  computed  tomography 
(Raptopoulos  et  al,  1996;  Boone  et  al,  2001)  are  being  developed  to  alleviate  this 
problem. 

A  conventional  radiograph  is  a  projection  image.  The  anatomical  structures  along 
the  x-ray  beam  path  are  projected  onto  a  two-dimensional  image  plane  and  overlap  with 
each  other.  The  overlying  tissue  structures  often  obscure  the  visibility  of  subtle  lesions  of 
interest  in  a  radiograph.  The  camouflaging  effect  of  the  anatomical  structures  is  the  main 
cause  of  missed  diagnosis.  Stereoscopic  imaging  will  allow  the  overlying  structures  to  be 
perceived  at  different  depths,  thereby  reducing  the  camouflaging  effect.  It  has  been 
reported  that  digital  stereomammography  allowed  the  detection  of  additional  lesions  that 
were  obscured  on  screen-film  mammograms  (Getty  et  al,  2001). 

Stereoscopic  radiography  has  been  attempted  for  different  types  of  examinations 
(Doi  et  al,  1981;  Kelsey  et  al,  1982;  Doi  and  Duda,  1983;  Higashida  et  al,  1988;  Trocme 


3 


et  al,  1990;  Ragnarsson  and  Karrholm,  1992).  The  principle  of  stereoscopic  imaging  is 
shown  in  Fig.  1.  The  x-ray  focal  spot  is  shifted,  along  a  direction  parallel  to  the  image 
plane,  to  the  left  and  the  right  of  the  central  axis  to  obtain  two  images  of  the  object.  The 
object  has  to  remain  stationary  during  the  process.  The  images  are  referred  to  as  the  left- 
eye  (LE)  and  the  right-eye  (RE)  image.  When  the  two  images  are  positioned  properly 
and  viewed  by  trained  eyes  or  with  the  aid  of  a  stereoscope  so  that  the  left  eye  sees  only 
the  LE  image  and  the  right  eye  sees  only  the  RE  image,  the  parallax  between  the  two 
images  creates  the  depth  perception.  It  is  important  to  match  the  amount  of  stereoscopic 
shift  to  the  imaging  geometry  to  obtain  best  depth  perception  with  minimal  eyestrain.  In 
general,  a  larger  stereoscopic  shift  produces  improved  depth  perception;  however,  as  the 
shift  increases,  it  becomes  more  difficult  for  the  observer  to  fuse  the  images  for  the 
stereoscopic  effect,  and  eye  fatigue  increases.  According  to  Christensen’s  Physics  of 
Diagnostic  Radiology  (Curry  et  al,  1992),  early  radiologists  determined  empirically  that  a 
tube  shift  of  10%  of  the  source-to-film  distance  worked  well.  This  translates  to  a  stereo 
shift  angle  of  about  ±3°  (tan*1  (0.05)  =  3°)  relative  to  a  normal  to  the  detector. 

Stereoscopic  imaging  has  not  achieved  widespread  acceptance  in  clinical  practice, 
mainly  because  of  the  doubled  film  cost  and  increased  patient  exposure  (Curry  et  al, 
1992).  A  secondary  problem  is  the  need  to  train  the  eyes  to  perceive  the  stereoscopic 
effect  without  aid,  or  to  use  a  special  stereoscope,  with  careful  arrangement  of  the  films. 
Digital  imaging  may  make  the  stereoscopic  technique  a  viable  approach  because  no 
additional  film  cost  will  be  required.  Furthermore,  a  digital  detector  has  a  wider  linear- 
response  range  and  a  higher  contrast  sensitivity  than  a  screen-film  system  so  that  good- 
quality  images  may  be  acquired  at  a  reduced  radiation  dose.  Images  in  digital  form  can 
be  subjected  to  image  processing,  further  enhancing  the  visibility  of  the  image  details. 
Digital  stereoscopic  images  can  be  viewed  on  a  single  electronic  display  device  that 
displays  the  left-eye  and  right-eye  images  alternately  at  a  high  refresh  rate.  The  observer 
views  the  displayed  images  through  a  stereo  goggle  such  as  a  pair  of  liquid  crystal 
display  (LCD)  glasses.  The  LCD  panels  act  as  electronic  shutters,  blocking  the  light  to 
the  left  eye  and  the  right  eye  alternately.  When  the  goggle  is  synchronized  with  the 
display  so  that  only  the  left  eye  can  see  the  left-eye  image  and  only  the  right  eye  can  see 
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the  right-eye  image  in  rapid  succession,  the  parallax  between  the  two  images  will  create  a 
stereo  effect.  The  stereoscopic  images  can  be  viewed  singly  in  the  conventional  manner 
or  stereoscopically  on  the  same  viewing  station  to  provide  complementary  diagnostic 
information. 

An  additional  advantage  of  stereoscopic  imaging  is  the  3-dimensional  (3D) 
information  it  provides  on  the  lesions  of  interest.  It  has  been  reported  that  the  3D 
distribution  of  microcalcifications  may  be  correlated  with  the  malignant  or  benign  nature 
of  the  cluster  (Conant  et  al,  1996;  Maidment  et  al,  1996).  Spiculations  from  a  mass  may 
be  more  readily  distinguished  from  overlapping  tissues  under  stereoscopic  viewing 
conditions.  This  supplementary  diagnostic  information  may  improve  the  classification  of 
malignant  and  benign  lesions,  thereby  reducing  unnecessary  biopsies  and  increasing  the 
positive  predictive  value  of  mammography. 

We  are  evaluating  the  application  of  stereoscopic  techniques  to  digital 
mammography.  Previously  we  studied  the  effects  of  stereo  shift  and  imaging  conditions 
on  the  depth  perception  of  fibrils  in  stereo  phantom  images  (Chan  et  al,  2001).  We  also 
demonstrated  that  a  virtual  cursor  could  provide  accurate  depth  measurements  in  stereo 
phantom  images  acquired  under  mammographic  conditions  (Goodsitt  et  al,  2000; 
Goodsitt  et  al,  2002).  In  the  present  study,  we  further  evaluated  the  effects  of  geometric 
magnification,  display  zooming,  and  x-ray  exposure  on  the  visual  depth  discrimination  of 
fibril-like  objects  in  stereo  phantom  mammograms. 

2.  MATERIALS  AND  METHODS 

2.1  Modular  Stereo  Phantom 

We  have  designed  a  modular  stereo  phantom  for  evaluation  of  depth  perception  in 
stereomammography.  A  schematic  of  the  phantom  is  shown  in  Fig.  2.  The  phantom 
consists  of  six  1-mm-thick  Lexan  sheets,  each  separated  by  1-mm-thick  spacers.  Each 
Lexan  plate  contains  a  5  X  5  array  of  object  areas.  Fifty  nylon  fibrils,  each  about  8-mm 
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in  length  and  0.53  mm  in  diameter,  are  arranged  in  these  object  areas.  Twenty-five  fibrils 
are  oriented  perpendicular  and  another  25  are  oriented  parallel  to  the  stereo  shift 
direction.  Henceforth,  we  will  refer  to  the  fibrils  oriented  in  the  perpendicular  direction  as 
“vertical”  and  the  fibrils  oriented  in  the  parallel  direction  as  “horizontal.”  On  average, 
eight  to  nine  fibrils  are  placed  in  the  object  areas  on  each  Lexan  plate.  The  location  and 
orientation  of  a  fibril  on  a  Lexan  plate  are  randomly  chosen  with  the  constraint  that,  in 
the  projection  image,  each  object  area  contains  the  projection  of  one  vertical  and  one 
horizontal  fibril  that  cross  each  other.  These  plates  can  be  arranged  in  different  orders  to 
produce  many  independent  object  configurations,  i.e.,  the  depth  separation  and  whether 
the  vertical  fibril  is  in  the  front  of  or  behind  the  horizontal  fibril  in  a  given  pair  change 
when  the  order  of  the  plates  changes.  Different  types  of  test  objects  such  as 
microcalcifications  may  be  used  in  place  of  the  fibrils  to  generate  a  different  phantom 
although  only  fibrils  were  used  in  the  present  study.  An  additional  1-mm-thick  Lexan 
plate  without  objects  is  placed  on  top  of  the  phantom  to  protect  the  test  objects  on  the  top 
layer.  The  total  thickness  of  Lexan  in  the  phantom  is  therefore  7  mm. 

2.2  Image  Acquisition  and  Display 

Digital  stereoscopic  image  pairs  were  acquired  with  a  GE  Senographe  2000D 
digital  mammography  system.  The  system  employs  a  digital  detector  consisting  of  a 
CsI:Tl  scintillator  and  an  amorphous-Si  active  matrix  flat  panel.  The  detector  measures 
23  cm  x  18  cm,  with  a  pixel  size  of  100  pm  x  100  pm.  We  acquired  stereoscopic  pairs  of 
images  using  x-ray  techniques  of  30  kVp,  Rh  target/Rh  filter,  a  ±3°  stereo-angle,  contact 
(reciprocating  grid,  0.3  mm  focal  spot)  and  1.8X  magnification  (no  grid,  0.15  mm  focal 
spot)  geometries,  and  exposures  of  4,  8,  32,  and  63  mAs  per  image.  A  relatively  hard  x- 
ray  beam  was  used  to  produce  lower  contrast  images,  thus  making  the  perception  task 
more  challenging. 

Since  the  digital  mammography  system  was  not  designed  for  stereo  imaging,  it  is 
not  easy  to  move  the  x-ray  focal  spot  to  the  angulated  positions  at  ±3°  from  the  central 
ray  for  imaging  the  stereo  pair.  We  used  an  equivalent  imaging  geometry  (Fig.  1)  in 
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which  the  phantom  was  shifted  instead  of  the  x-ray  source.  Comparing  the  two 
geometries  in  Fig.  1,  it  can  be  seen  that  the  position  of  the  x-ray  source  relative  to  the 
phantom  is  the  same  except  that  the  focal-spot-to-detector  distance  is  slightly  shorter  in 
the  phantom-shift  geometry  because  the  x-ray  source  moves  along  an  arc.  However,  with 
the  3°  shift  about  a  fulcrum  of  rotation  at  a  distance  of  46  cm  from  the  x-ray  focal  spot, 
this  error  is  less  than  0.1%.  Using  the  geometry  of  the  x-ray  system,  we  calculated  that  a 
±3°  stereo  shift  of  the  x-ray  focal  spot  is  equivalent  to  a  phantom  shift  distance  of  ±2.4 
cm  from  its  central  position.  The  shift  distance  is  the  same  for  either  the  contact 
geometry  or  the  magnification  geometry. 

We  built  a  phantom  platform  with  Lexan  (Fig.  3)  to  move  the  phantom  from  one 
position  to  the  other  in  a  direction  parallel  to  the  chest  wall  for  acquisition  of  the  stereo 
pair.  The  platform  has  a  stationary  base  that  is  fitted  on  the  Bucky  holder  for  contact 
geometry  or  on  the  magnification  stand  for  magnification  geometry.  A  sliding  plate  on 
top  of  the  base  is  used  to  support  and  move  the  phantom  parallel  to  the  chest  wall 
direction  of  the  mammography  system.  The  sliding  plate  is  guided  by  two  guardrails 
parallel  to  the  chest  wall  to  ensure  a  precise  and  reproducible  movement.  The  total 
thickness  of  the  Lexan  platform  is  1.7  cm.  During  image  acquisition,  care  was  taken  such 
that  the  phantom  remained  stationary  on  the  sliding  plate  while  the  plate  was  moved 
between  the  two  shifted  positions.  Pictures  of  the  phantom  platform  at  the  left  and  right 
shifted  positions  in  the  contact  geometry  are  shown  in  Fig.  3. 

Three  different  configurations  of  the  fibril  phantoms  were  imaged  under  each 
exposure  condition.  Twenty-four  (=  3  phantoms  X  4  exposures  X  2  geometries)  stereo 
image  pairs  were  thus  produced.  For  each  exposure  and  geometry  condition,  there  were  a 
total  of  75  pairs  of  fibril  images  (25  fibril  pairs  in  each  phantom  configuration  x  3 
configurations)  at  5  different  depth  separations  (2,  4,  6,  8,  10  mm)  to  be  evaluated.  An 
example  of  a  stereo  image  pair  acquired  with  contact  geometry  is  shown  in  Fig.  4. 

The  images  were  displayed  on  a  21"  Barco-Metheus  (Beaverton,  OR)  model  521 
display  monitor  driven  by  a  Barco-Metheus  model  1760S  stereoscopic  board  and  a  SUN 
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Microsystems  (Palo  Alto,  CA)  Ultra  10  computer  using  in-house  developed  software. 
The  Metheus  board  displays  1408  x  1408  x  8  bit  images  at  a  refresh  rate  of  114  Hz.  It 
operates  in  a  page  flipping  stereoscopic  mode  with  the  left-  and  right-eye  images 
displayed  alternately.  NuVision  (Beaverton,  OR)  LCD  stereoscopic  glasses  were  used 
for  viewing  the  stereoscopic  images.  The  stereo  workstation  is  shown  in  Fig.  5. 

2.3  Observer  Experiment 

Five  observers  including  two  experienced  mammographic  radiologists 
participated  in  the  experiment.  All  observers  took  a  standard  Randot  Circles  Stereo  test 
(Stereo  Optical  Co.,  Inc.,  Chicago,  IL)  to  evaluate  their  stereo  acuity.  In  this  test,  the 
observers  viewed  ten  rows  of  test  objects  through  polarized  glasses.  Each  row  contains  3 
objects,  one  of  which  is  the  object  that  exhibits  the  stereo  effect  and  appears  to  be  on  a 
plane  different  from  the  other  two  objects.  The  difference  progressively  decreases  due  to 
decreasing  stereo  shift,  and  thus  increasing  the  degree  of  difficulty.  The  observers  had  to 
determine  which  one  was  the  stereo  object  in  each  row.  All  of  our  observers  could 
correctly  identify  all  the  objects  in  the  test,  indicating  that  their  stereo  acuity  was  at  least 
20  sec  of  arc  at  a  viewing  distance  of  16”.  Their  performance  is  comparable  to  the 
average  performance  (21.3  sec  of  arc)  for  adults  with  excellent,  balanced  monocular 
visual  acuity  measured  with  this  test  pattern  (Simons,  1981). 

For  our  experiment,  the  task  for  the  observers  was  to  visually  judge  whether  the 
vertical  fibril  in  each  pair  of  overlapping  fibrils  was  in  front  of  (closer  to  the  observer)  or 
behind  the  horizontal  fibril.  The  observer  was  not  informed  of  the  truth  after  reading 
each  image.  Each  observer  read  the  images  sequentially  in  a  different  randomized  order. 
The  reading  order  of  the  fibril  pairs  in  the  5  X  5  matrix  in  a  given  image  was  changed 
randomly  by  changing  the  starting  location  and  the  reading  direction,  e.g.,  from  the  upper 
left  comer  and  by  row,  from  the  upper  left  comer  and  by  column,  from  the  lower  right 
comer  and  by  row,  etc.,  in  an  effort  to  further  reduce  any  potential  effects  of 
memorization.  The  contact  images  were  read  in  two  modes  -  in  a  regular  and  in  a  2X- 
zoom  mode,  referred  to  as  the  contact  and  contact-zoom  mode,  respectively.  The  1.8X 
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geometric  magnification  images  were  read  only  in  the  regular  mode,  referred  to  as  the 
magnification  mode.  The  contact  and  the  contact-zoom  modes  of  the  same  image  were 
not  read  consecutively  so  that  it  was  unlikely  that  the  observer  would  remember  the 
results  of  the  other  mode.  The  observers  were  not  informed  of  the  conditions  under  which 
the  image  being  viewed  was  acquired,  although  the  difference  in  image  sizes  between  the 
contact  and  the  magnification  or  contact-zoom  images  were  apparent.  Prior  to  reading 
the  test  cases,  the  observers  participated  in  training  sessions  to  become  familiar  with  the 
reading  task. 

3.  RESULTS 

In  this  study,  we  quantified  the  accuracy  of  depth  perception  in  stereo  images  by 
an  observer  as  the  percentage  of  correct  decisions  to  differentiate  the  relative  depths  of 
the  fibrils.  The  results  were  averaged  over  the  5  observers.  The  dependences  of  the 
average  percentage  of  correct  decisions  on  the  depth  separation  of  the  crossing  fibrils  and 
the  exposure  levels  for  the  contact,  contact-zoom,  and  magnification  modes  are  shown  in 
Fig.  6(a)  to  Fig.  6(c),  respectively.  Generally,  the  percentage  of  correct  decisions 
increases  as  the  exposure  increases  and  as  the  depth  separation  between  the  two  fibrils 
increases.  The  dependence  on  the  depth  separation  diminishes  as  the  exposure  increases. 
At  small  depth  separations,  the  noise  in  the  images  has  a  much  stronger  influence  on  the 
depth  perception.  The  percentage  of  correct  decisions  increases  rapidly  as  the  exposure 
increases.  At  a  depth  separation  of  10  mm,  the  percentage  of  correct  decisions  was  100% 
for  all  observers  in  all  three  modes,  regardless  of  exposure  levels.  The  curves  for  contact 
mode  are  very  similar  to  those  for  the  contact-zoom  mode.  On  the  other  hand,  the  curves 
for  the  magnification  mode  are  much  higher  than  those  of  the  contact  or  contact-zoom 
mode.  The  standard  deviation  of  the  percentage  of  correct  decisions  varied  from  0  to 
about  13%  for  the  contact  mode  and  the  contact-zoom  mode,  and  varied  from  0  to  6.7% 
for  the  magnification  mode.  The  standard  deviation  generally  increased  as  the  percentage 
of  correct  decisions  decreased.  The  standard  deviation  was  zero  for  the  conditions  in 
which  the  average  percentage  of  correct  decisions  was  100%  because  all  observers  were 
100%  correct  in  their  decisions. 
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The  statistical  significance  of  the  differences  between  every  two  modes,  contact 
vs  contact-zoom,  contact  vs  magnification,  and  contact-zoom  vs  magnification,  was 
estimated  by  a  two-tailed  paired-t  test.  The  paired  t-test  was  performed  for  each  depth 
separation  and  exposure  level  over  the  5  observers.  The  p-values  for  the  contact-vs- 
magnification  and  contact-zoom-vs-magnification  for  the  various  exposure  and  depth 
separation  conditions  are  shown  in  Table  1  and  Table  2,  respectively.  The  differences 
between  the  contact  and  the  magnification  modes  are  statistically  significant  (p 
value<0.05)  for  depth  separations  of  2  mm  to  6  mm  at  4  mAs,  and  for  a  2-mm  separation 
at  8  mAs.  The  differences  between  the  contact-zoom  and  the  magnification  modes  are 
statistically  significant  for  depth  separations  of  2  mm  to  6  mm  at  4  mAs,  for  2-mm  to  4- 
mm  separations  at  8  mAs,  and  for  a  2-mm  separation  at  32  mAs.  The  differences 
between  the  contact  and  contact-zoom  modes  are  not  statistically  significant. 

We  further  analyzed  separately  the  reading  results  for  two  subgroups  of  crossing 
fibrils,  one  subgroup  with  the  vertical  fibril  in  front  of  (referred  to  as  the  “front  group”) 
and  the  other  behind  (referred  to  as  the  “back  group”)  the  horizontal  fibril.  The  average 
percentage  of  correct  decisions  as  a  function  of  depth  separation  was  obtained  for  each 
exposure  level,  similar  to  the  analysis  for  the  entire  group  described  above.  We  observed 
that  the  average  percentage  of  correct  decisions  for  the  front  group  was  often  greater  than 
that  for  the  back  group  for  a  given  exposure  and  a  given  depth  separation.  A  histogram 
of  the  differences  between  the  average  percentage  of  correct  decisions  for  the  front  group 
and  that  for  the  back  group  under  the  corresponding  conditions  is  plotted  in  Fig.  7  for  the 
60  conditions  studied  (4  exposure  levels  X  5  depth  separations  X  3  modes).  Of  the  60 
differences,  only  three  were  negative,  i.e.,  the  average  percentage  of  correct  decisions  for 
the  front  group  was  smaller  than  that  for  the  back  group.  All  28  zeroes  (no  difference) 
happened  when  both  the  front  group  and  the  back  group  were  100%  correct.  These 
occurred  when  the  depth  separations  were  large  and  the  exposures  were  high.  The  other 
29  differences  were  positive,  i.e.,  the  percentage  of  correct  decisions  for  the  front  group 
was  larger  than  that  for  the  back  group.  However,  paired  t-tests  of  the  differences 
between  the  front  and  the  back  group  under  each  condition  did  not  reach  statistical 
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significance,  probably  due  to  the  smaller  numbers  of  samples  when  they  were  separated 
into  subgroups. 


4.  DISCUSSION 

Depth  perception  in  stereomammography  depends  on  a  number  of  factors 
including  the  x-ray  exposure,  depth  separation,  and  imaging  geometry.  In  this  study,  we 
investigated  the  dependence  of  the  percentage  of  correct  decisions  in  differentiating  the 
relative  depths  of  two  crossing  fibrils  on  these  factors  using  images  acquired  with  ±3° 
stereo  angle.  We  found  that  a  2-mm  depth  resolution  could  be  achieved  with  over  60% 
accuracy  for  all  imaging  conditions  studied.  For  contact  geometry,  the  accuracy 
improved  to  greater  than  90%  at  higher  exposures.  Magnification  stereomammography 
provided  over  90%  accuracy  at  a  2-mm  depth  resolution  for  all  exposure  levels  studied. 
An  interesting  finding  was  that  displaying  the  stereo  images  acquired  with  contact 
geometry  in  2X  zoom  mode  did  not  improve  the  depth  discrimination  accuracy.  In 
contrast,  geometric  magnification  with  about  the  same  factor  (1.8X)  of  enlargement 
significantly  improved  depth  perception.  This  result  indicated  that  the  signal-to-noise 
ratio  (SNR)  might  be  a  more  important  factor  affecting  depth  perception  than  the 
perceived  object  size.  When  the  images  are  acquired  with  geometric  magnification,  both 
the  spatial  resolution  of  the  detector  relative  to  the  object  and  the  x-ray  quanta  per  unit 
object  area  increase  (Doi  and  Rossmann,  1974;  Doi  and  Imhof,  1977),  although 
geometric  unsharpness  may  somewhat  reduce  the  gain  in  resolution.  The  improved 
detector  resolution  and  reduced  quantum  mottle  contributed  to  an  increase  in  the  SNR  of 
the  image.  On  the  other  hand,  if  the  images  were  acquired  in  contact  geometry  and  the 
object  size  was  enlarged  electronically  by  zooming  during  display,  the  inherent  SNR  of 
the  object  in  the  images  remained  fixed.  The  differences  in  the  perceived  SNRs  (Loo  et 
al,  1985;  Aufrichtig,  1999)  between  the  contact  mode  and  the  contact-zoom  mode  would 
be  mainly  caused  by  the  change  in  the  perceived  noise  of  the  display  monitor  relative  to 
the  object  size  as  well  as  the  change  in  the  perceived  signal  and  image  noise  spectra  due 
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to  zooming  relative  to  the  frequency  response  of  the  observer’s  visual  system.  Display 
zooming  may  have  a  strong  influence  if  the  perception  is  limited  by  the  resolution  of  the 
human  visual  system.  In  our  case,  the  objects  were  relatively  large  and  it  was  unlikely 
that  they  were  near  the  resolution  limit  of  the  observers’  visual  system.  The  improved 
SNR  inherent  in  the  geometrically  magnified  images  may  therefore  have  a  dominant 
effect  on  depth  discrimination  compared  with  that  of  increased  displayed  object  size. 
This  may  be  the  reason  that  display  zoom  did  not  have  a  strong  impact  on  the  accuracy 
of  depth  perception  in  this  study. 

We  plotted  the  average  percentage  of  correct  decisions  as  a  function  of  log 
exposure  (mAs)  for  each  depth  separation  between  the  two  crossing  fibrils  in  the  pair  as 
shown  in  Fig.  8(a)  and  8(b),  respectively,  for  the  contact  and  contact-zoom  modes.  The 
average  percentages  of  correct  decisions  for  the  magnification  mode  under  all  conditions 
were  greater  than  90%  and  were  not  plotted.  Three  of  the  data  points  at  a  8-mm  depth 
separation  appear  to  be  lower  than  those  at  a  6-mm  depth  separation  for  a  given  exposure. 
Since  the  standard  deviation  at  each  of  these  data  points  is  about  twice  as  large  as  the 
difference  between  the  percentage  of  correct  decisions  at  6-mm  and  8-mm  separations, 
the  apparent  local  reverse  of  the  trend  can  likely  be  attributed  to  experimental 
uncertainties.  From  the  curves  of  the  contact  and  contact-zoom  modes,  it  appears  that 
there  is  no  simple  relationship  between  the  percentage  of  correct  decisions  and  log 
exposure.  The  curve  shape  varied  among  the  different  depth  separations  and  they  were 
not  linear.  The  percentage  of  correct  decisions  increased  with  exposure  more  rapidly  at 
low  dose  levels  and  leveled  off  at  high  doses.  Depth  discrimination  is  different  from  a 
single-object  detection  task.  The  relationships  among  the  perceived  depth  separation,  the 
SNR’s  of  the  individual  objects,  and  the  percentage  of  correct  decisions  are  still 
unknown.  Further  studies  are  needed  to  explore  how  depth  discrimination  is  related  to 
the  SNR  of  the  individual  objects  and  if  the  depth  discrimination  task  can  be  predicted  by 
SNR  models. 

The  intraobserver  variability  was  estimated  from  two  repeated  readings  of  the  set 
of  test  images  by  one  observer.  The  difference  between  the  two  readings  for  each 
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exposure  level  and  depth  separation  was  calculated.  The  difference  in  the  percentage  of 
correct  decisions  between  the  two  readings  varied  from  0  to  20%,  from  0  to  8%,  and  from 
0  to  8%,  respectively,  for  the  contact,  contact-zoom,  and  magnification  modes.  The 
variability  generally  increased  with  decreasing  depth  separation  and  decreasing  exposure. 
There  were  no  differences  between  the  two  readings  at  depth  separations  of  8  mm  and  10 
mm  for  all  exposure  levels  and  all  image  modes.  For  the  magnification  mode,  the  two 
repeated  readings  were  identical  for  18  of  the  20  conditions  (5  depth  separations  and  4 
exposure  levels).  A  difference  was  observed  only  at  a  2-mm  separation  with  the  two 
lower  exposure  levels,  4  mAs  and  8  mAs.  For  both  the  contact  and  contact-zoom  modes, 
14  of  the  20  conditions  were  identical.  Four  of  the  6  differences  occurred  at  a  2-mm 
separation  with  the  four  exposure  levels  (4,  8,  32, 63  mAs). 

In  a  previous  study,  we  designed  a  virtual  cursor  to  measure  the  absolute  depths 
of  the  fibrils  in  stereo  phantom  images  similar  to  those  used  in  this  study.  We  found  that 
the  accuracy  of  the  absolute  depth  measurement  also  depended  on  the  image  modes.  The 
accuracy  of  the  measurements  in  contact-zoom  mode  was  similar  to  those  in  contact 
mode,  whereas  the  accuracy  was  higher  when  measured  in  the  images  acquired  with 
geometric  magnification  (Goodsitt  et  al,  2002).  These  results  are  consistent  with  the 
observation  in  the  current  depth  perception  experiments. 

5.  CONCLUSIONS 

The  accuracy  of  depth  discrimination  of  fibrils  in  stereomammography  increases 
with  x-ray  exposure  and  depth  separation  and  depends  on  imaging  geometry.  At  a  stereo 
angle  of  ±3°,  a  2-mm  depth  resolution  was  achieved  with  over  60%  accuracy  for  all 
imaging  conditions  studied.  It  improved  to  greater  than  90%  accuracy  at  higher  doses  in 
contact  geometry.  With  magnification  stereomammography,  a  2-mm  depth  resolution 
was  achieved  with  greater  than  90%  accuracy  for  all  exposure  levels  studied.  It  was 
found  that  zooming  the  contact  stereo  images  by  2X  did  not  improve  the  accuracy  under 
our  experimental  conditions.  When  the  images  were  noisy  and  the  depth  separation 
between  the  fibrils  was  small,  depth  discrimination  was  significantly  better  in  stereo 
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images  acquired  with  geometric  magnification  than  in  images  acquired  with  a  contact 
technique  and  displayed  with  or  without  zooming.  These  results  indicate  that 
stereoscopic  imaging,  and  in  particular,  magnification  stereomammography,  may  be 
useful  for  visualizing  the  spatial  distribution  of  microcalcifications  in  a  cluster  and 
differentiating  overlapping  tissues  from  masses  on  mammograms.  Further  studies  are 
underway  to  investigate  the  dependence  of  depth  perception  on  the  shape  and  size  of  the 
objects  and  to  evaluate  if  specially  designed  cursors  can  assist  in  depth  discrimination  of 
target  objects  in  stereoscopic  images.  An  observer  experiment  is  being  conducted  to 
evaluate  the  characterization  of  mammographic  lesions  in  stereo  images  of  biopsy  tissue 
specimens. 
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Table  1.  The  p-values  from  the  two-tailed  paired  t-test  of  the  differences  in  the 
percentage  of  correct  decisions  in  differentiating  the  depths  of  two  crossing 
fibrils  between  the  contact  and  the  magnification  mode.  The  entries  indicated  by 
“ — have  p-values  >  0.05  so  that  the  differences  are  not  statistically  significant. 
The  two  entries  indicated  by  — *  have  p-values  of  0.089  and  0.065,  close  to 
being  significant. 


Depth  Separation 

Exposure 

(mm) 

4  mAs 

8  mAs 

32  mAs 

63  mAs 

2 

0.007 

0.000 

_ * 

— 

4 

0.009 

_ * 

— 

— 

6 

8 

10 

0.034 

— 

— 

— 

— 

— 

— 

— 

Table  2.  The  p-values  from  the  two-tailed  paired  t-test  of  the  differences  in  the 
percentage  of  correct  decisions  in  differentiating  the  depths  of  two  crossing 
fibrils  between  the  contact-zoom  and  the  magnification  mode.  The  entries 
indicated  by  “• — ■“  have  p-values  >  0.05  so  that  the  differences  are  not  statistically 
significant. 


Depth  Separation 

Exposure 

(mm) 

4  mAs 

8  mAs 

32  mAs 

63  mAs 

2 

0.014 

0.003 

0.011 

— 

4 

0.016 

0.003 

— 

— 

6 

8 

10 

0.021 

— 

— 

— 

— 

— 

— 

— 
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FIGURE  CAPTIONS 


Fig.  1.  Imaging  geometry  for  acquisition  of  stereoscopic  image  pairs.  On  the  left  is  a 
conventional  “focal-spot-shift”  method  in  which  the  focal  spot  is  shifted  to  the 
left  and  to  the  right  by  a  distance  of  w  to  expose  the  left-eye  and  right-eye 
images.  On  the  right  is  an  equivalent  “phantom-shift”  method  in  which  the 
phantom  is  shifted  to  the  left  and  the  right  of  the  central  ray  by  a  distance  of  w. 
The  “phantom  (R)”  geometry  corresponds  to  the  “f.s.  (R)”  geometry,  and  the 
“phantom  (L)”  geometry  corresponds  to  the  “f.s.  (L)”  geometry. 

Fig.  2.  A  modular  stereo  phantom  consists  of  six  layers  of  Lexan  plates  on  which  nylon 
fibrils  were  pasted  either  in  the  horizontal  or  the  vertical  direction  in  one  of  the 
5X5  matrix  locations  on  one  of  the  plates.  By  properly  arranging  50  fibrils  on 
the  six  plates,  the  projected  image  will  contain  25  pairs  of  crossing  fibrils  with 
different  depth  separations  between  the  two  fibrils. 

Fig.  3.  The  phantom  platform  placed  on  top  of  the  detector  of  the  digital  mammography 
system  in  the  setup  for  contact  imaging.  The  sliding  plate  with  the  stereo 
phantom  was  shifted  to  the  left  in  (a)  and  to  the  right  in  (b)  at  a  distance 
equivalent  to  a  ±3°  stereo  angle. 

Fig.  4.  A  stereo  image  pair  acquired  in  contact  geometry:  (a)  left-eye  image,  (b)  right- 
eye  image,  (c)  displayed  stereo  image  -  the  25  pairs  of  crossing  fibrils  showed 
different  degrees  of  stereo  shift  due  to  the  different  depth  separations  between 
the  two  fibrils. 

Fig.  5.  The  SUN-based  Barco-Metheus  stereo  display  workstation  used  in  the  observer 
study. 

Fig.  6.  Percentage  of  correct  decisions  in  differentiating  the  relative  depths  of  two 
crossing  fibrils,  averaged  over  5  observers,  (a)  Stereo  images  acquired  with 
contact  geometry,  (b)  Stereo  images  acquired  with  contact  geometry,  displayed 
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with  2X  zoom,  and  (c)  Stereo  images  acquired  with  1.8X  geometric 
magnification. 

Fig.  7.  Histogram  of  the  difference  in  the  percentage  of  correct  decisions  between  the 
front  group  (vertical  fibril  in  front  of  horizontal  fibril)  and  the  back  group 
(vertical  fibril  behind  horizontal  fibril). 

Fig.  8.  Dependence  of  the  percentage  of  correction  decisions  on  the  logarithm  of 
exposure,  (a)  Contact  mode,  (b)  Contact-zoom  mode. 
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f.s.  (L) 


Fig.  1.  Imaging  geometry  for  acquisition  of  stereoscopic  image  pairs.  On  the  left  is  a 
conventional  “focal-spot-shift”  method  in  which  the  focal  spot  is  shifted  to  the 
left  and  to  the  right  by  a  distance  of  w  to  expose  the  left-eye  and  right-eye  images. 
On  the  right  is  an  equivalent  “phantom-shift”  method  in  which  the  phantom  is 
shifted  to  the  left  and  the  right  of  the  central  ray  by  a  distance  of  w.  The 
“phantom  (R)”  geometry  corresponds  to  the  “f.s.  (R)”  geometry,  and  the 
“phantom  (L)”  geometry  corresponds  to  the  “f.s.  (L)”  geometry. 
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Fig.  2.  A  modular  stereo  phantom  consists  of  six  layers  of  Lexan  plates  on  which  nylon 
fibrils  were  pasted  either  in  the  horizontal  or  the  vertical  direction  in  one  of  the 
5X5  matrix  locations  on  one  of  the  plates.  By  properly  arranging  50  fibrils  on 
the  six  plates,  the  projected  image  will  contain  25  pairs  of  crossing  fibrils  with 
different  depth  separations  between  the  two  fibrils. 
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(a)  (b) 


Fig.  3.  The  phantom  platform  placed  on  top  of  the  detector  of  the  digital  mammography 
system  in  the  setup  for  contact  imaging.  The  sliding  plate  with  the  stereo  phantom 
was  shifted  to  the  left  in  (a)  and  to  the  right  in  (b)  at  a  distance  equivalent  to  a  ±3° 
stereo  angle. 
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(C) 


Fig.  4.  A  stereo  image  pair  acquired  in  contact  geometry:  (a)  left-eye  image,  (b)  right-eye 
image,  (c)  displayed  stereo  image  -  the  25  pairs  of  crossing  fibrils  showed  different 
degrees  of  stereo  shift  due  to  the  different  depth  separations  between  the  two  fibrils. 
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Fig.  5.  The  SUN-based  Barco-Metheus  stereo  display  workstation  used  in  the 
observer  study. 
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Percentage  of  Correct  Decisions 


(C) 

Fig.  6.  Percentage  of  correct  decisions  in  differentiating  the  relative  depths  of  two 
crossing  fibrils,  averaged  over  5  observers,  (a)  Stereo  images  acquired  with 
contact  geometry,  (b)  Stereo  images  acquired  with  contact  geometry,  displayed 
with  2X  zoom,  and  (c)  Stereo  images  acquired  with  1.8X  geometric 
magnification. 
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Fig.  7.  Histogram  of  the  difference  in  the  percentage  of  correct  decisions  between  the 
front  group  (vertical  fibril  in  front  of  horizontal  fibril)  and  the  back  group 
(vertical  fibril  behind  horizontal  fibril). 
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Digital  Stereomammography:  Observer  Performance  Study  of 
the  Effects  of  Magnification  and  Zooming  on  Depth  Perception 
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ABSTRACT 

We  have  previously  reported  the  effects  of  stereo  angle  and  exposure  on  depth  discrimination  and  the  use  of  virtual 
cursors  for  absolute  depth  measurements  in  digital  stereomammography.  The  current  study  further  investigates  the  effects  of 
magnification  and  zooming  on  depth  perception.  Stereoscopic  image  pairs  of  a  phantom  were  acquired  with  a  full-field 
digital  mammography  system.  The  modular  phantom  contained  25  crossing  fibril  pairs  with  depth  separations  between  each 
pair  ranging  from  2  to  10  mm.  Three  phantom  (fibril)  configurations  were  imaged  using  techniques  of  30  kVp,  Rh/Rh,  ±3° 
stereo  angle, ,  contact  and  1.8X  magnification  geometry,  and  4  to  63  mAs  exposure  range  .  The  images  were  displayed  on  a 
Barco  monitor  driven  by  a  Metheus  stereo  graphics  board  and  viewed  with  LCD  stereo  glasses.  Five  observers  participated 
in  the  study.  Each  observer  visually  judged  if  the  vertical  fibril  was  in  front  of  or  behind  the  horizontal  fibril  in  each  pair.  It 
was  found  that  the  accuracy  of  depth  discrimination  increased  with  increasing  fibril  depth  separation  and  x-ray  exposure. 
Zooming  the  contact  stereo  images  by  2X  did  not  improve  the  accuracy.  Under  conditions  of  high  noise  (low  mAs)  and 
small  depth  separation  between  the  fibrils,  depth  discriminations  were  significantly  better  in  stereo  images  acquired  with 
geometric  magnification  than  in  images  acquired  with  a  contact  technique  and  displayed  with  or  without  zooming.  This 
study  indicates  that  stereoscopic  imaging,  especially  with  magnification,  may  be  useful  for  visualizing  the  spatial  distribution 
of  microcalcifications  in  a  cluster  and  differentiating  overlapping  tissues  from  masses  on  mammograms. 

KEY  WORDS:  Digital  mammography,  stereoscopic  imaging,  magnification,  observer  performance  study. 

1.  INTRODUCTION 

Mammography  is  the  most  sensitive  method  for  detecting  early  breast  cancers.  However,  because  of  the  projection 
of  the  breast  tissues  along  the  x-ray  beam  path  onto  a  two-dimensional  image  plane,  one  of  the  major  limitations  in 
mammography  is  the  low  sensitivity  for  detecting  lesions  overlapping  with  dense  fibroglandular  tissues1.  It  has  been 
estimated  that  about  20%  of  breast  cancers  in  dense  breasts  are  missed  x  3.  The  camouflaging  effect  of  overlapping  structures 
is  the  main  cause  of  missed  diagnoses.  New  breast  imaging  techniques  such  as  stereomammography4*7,  digital 
tomosynthesis8, 9,  and  computed  tomography10  may  alleviate  this  problem. 

Stereoscopic  imaging  requires  acquisition  of  two  images.  The  x-ray  focal  spot  is  shifted,  along  a  direction  parallel 
to  the  image  plane,  to  the  left  and  the  right  of  the  central  axis  to  obtain  two  images,  referred  to  as  the  left-eye  and  the  right- 
eye  images,  respectively,  of  the  object.  When  the  two  images  are  placed  properly  and  viewed  so  that  the  left  eye  sees  only 
the  left-eye  image  and  the  right  eye  sees  only  the  right-eye  image,  the  parallax  between  the  two  images  creates  the  depth 
perception.  Stereoscopic  radiography  has  been  attempted  for  different  types  of  examinations  but  it  has  not  achieved 
widespread  acceptance  in  clinical  practice,  however,  mainly  because  of  the  doubled  film  cost  and  increased  patient  exposure 
11 .  The  recent  advent  of  direct  digital  detectors  may  make  the  stereoscopic  technique  a  viable  approach  because  no  additional 
film  cost  will  be  required.  Furthermore,  a  digital  detector  has  a  wider  dynamic  range  and  higher  contrast  sensitivity  than  a 
screen-film  system  so  that  good-quality  images  may  be  acquired  at  a  reduced  radiation  dose.  Digital  stereoscopic  images  can 
be  viewed  on  a  single  display  monitor  with  the  assistance  of  stereoscopic  goggles  that  provide  an  electronic  shutter  to  show 
the  left-  and  right-eye  images  to  the  respective  eyes.  The  stereoscopic  images  can  therefore  be  displayed  singly  in  the 
conventional  manner  or  stereoscopically  on  the  same  viewing  station  to  provide  complementary  diagnostic  information. 

An  advantage  of  stereoscopic  imaging  is  the  three-dimensional  (3D)  structural  information  that  it  provides  for  the 
lesions  of  interest.  The  3D  distribution  of  microcalcifications  may  be  correlated  with  the  malignant  or  benign  nature  of  the 
cluster12, 13.  Spiculations  from  a  mass  may  also  be  more  readily  distinguished  from  overlapping  tissues  under  stereoscopic 
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viewing  conditions.  The  additional  diagnostic  information  may  improve  the  classification  of  malignant  and  benign  lesions, 
thereby  reducing  unnecessary  biopsies.  It  has  been  reported  that  digital  stereomammography  allowed  the  detection  of 
additional  lesions  that  were  obscured  on  screen-film  mammograms4. 

We  are  investigating  the  usefulness  of  stereomammography  for  discriminating  the  depths  of  subtle  mammographic 
features.  We  previously  demonstrated  that  a  virtual  cursor  could  provide  accurate  depth  measurements  in  stereo  phantom 
images  acquired  under  mammographic  conditions5, 6’ 14.  We  also  studied  the  effects  of  stereo  shift  and  imaging  conditions  on 
the  depth  perception  of  crossing  fibrils  in  stereo  phantom  images15.  In  this  study,  we  further  evaluated  the  effects  of 
geometric  magnification,  display  zooming,  and  x-ray  exposure  on  the  visual  depth  discrimination  of  fibril-like  objects  in 
stereo  phantom  mammograms.  The  results  of  our  observer  performance  study  are  discussed  in  this  paper. 

2.  MATERIALS  AND  METHODS 


2.1  Phantom  Design 

We  have  designed  a  modular  stereo  phantom  for  evaluation  of  the  depth  perception  task.  The  phantom  consists  of 
six  1-mm-thick  Lexan  sheets,  each  separated  by  1-mm-thick  spacers.  Each  Lexan  plate  contains  a  5  X  5  array  of  object 
areas.  Fifty  nylon  fibrils,  each  about  8-mm  in  length  and  0.53  mm  in  diameter,  are  arranged  in  these  object  areas.  Twenty- 
five  fibrils  are  oriented  vertically  (perpendicular)  and  25  horizontally  (parallel)  to  the  stereo  shift  direction.  The  fibrils  are 
placed  in  the  object  areas  on  the  six  Lexan  plates  such  that,  in  the  projection  image,  each  object  area  contains  the  projection 
of  one  vertical  and  one  horizontal  fibril  that  cross  each  other.  The  depth  separation  of  each  pair  of  crossing  fibrils  depends 
on  the  arrangement  of  the  plates.  These  plates  can  be  arranged  in  different  orders  to  produce  many  independent  object 
configurations. 

2.2  Image  Acquisition  and  Display 

Digital  stereoscopic  image  pairs  were  acquired  with  a  GE  Senographe  2000D  digital  mammography  system.  The 
system  employs  a  digital  detector  consisting  of  a  CsI:Tl  scintillator  and  an  amorphous-Si  active  matrix  flat  panel.  The 
detector  measures  23  cm  x  18  cm,  with  a  pixel  size  of  100  pm  x  100  pm.  We  acquired  stereoscopic  pairs  of  images  using  x- 
ray  techniques  of  30  kVp,  Rh  target/Rh  filter,  a  ±3°  stereo-angle,  contact  (reciprocating  grid,  0.3  mm  focal  spot)  and  1.8X 
magnification  (no  grid,  0.15  mm  focal  spot)  geometies,  and  exposures  of  4,  8,  32,  and  63  mAs  per  image.  Three  different 
configurations  of  the  fibril  phantoms  were  imaged  under  each  exposure  condition.  Twenty- four  stereo  image  pairs  were  thus 
produced.  For  each  exposure/geometry  condition,  there  were  a  total  of  75  pairs  of  fibril  images  (25  fibril  pairs  in  each 
phantom  configuration  x  3  configurations)  at  5  different  depth  separations  (2, 4,  6,  8, 10  mm)  to  be  evaluated. 

The  images  were  displayed  on  a  21"  Barco-Metheus  (Beaverton,  OR)  model  521  display  monitor  driven  by  a  model 
1760S  stereoscopic  board  and  a  SUN  Microsystems  (Palo  Alto,  CA)  Ultra  10  computer.  The  Metheus  board  displays  1408  x 
1408  x  8  bit  images  at  a  refresh  rate  of  1 14  Hz  .  It  operates  in  a  page  flipping  stereoscopic  mode  with  the  left-  and  right-eye 
images  displayed  alternately.  NuVision  (Beaverton,  OR)  LCD  stereoscopic  glasses  were  used  for  viewing  the  stereoscopic 
images. 


2.3  Observer  Experiment 

Five  observers  including  two  experienced  mammographic  radiologists  participated  in  the  experiment.  The  contact 
images  were  read  in  two  modes  -  a  regular  and  a  2X-zoom  mode.  The  1.8X  geometric  magnification  images  were  read  only 
in  the  regular  mode.  The  observers  were  asked  to  visually  judge  if  the  vertical  fibril  in  each  pair  of  overlapping  fibrils  was  in 
front  of  or  behind  the  horizontal  fibril.  Each  observer  read  the  images  sequentially  in  a  different  randomized  order.  The 
observers  were  not  informed  of  the  conditions  under  which  the  image  being  viewed  was  acquired.  Prior  to  reading  the  test 
cases,  the  observers  participated  in  training  sessions  to  become  familiar  with  the  reading  task. 

3.  RESULTS 

Tables  1-3  summarize  the  percentages  of  correct  decisions  on  the  relative  depths  as  a  function  of  the  depth 
separation  of  the  crossing  fibrils,  averaged  over  5  observers,  for  the  different  exposure  levels  studied.  The  statistical 
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significance  (two-tailed  p  level<0.05)  of  the  differences  between  every  two  conditions:  contact  and  contact-zoom,  contact 
and  magnification,  and  contact-zoom  and  magnification  was  estimated  by  a  paired-t  test.  The  t-test  was  performed  for  each 
depth  separation  and  exposure  level  over  the  5  observers.  It  was  found  that  the  differences  between  the  contact  and  contact- 
zoom  viewing  conditions  were  not  statistically  significant.  The  differences  between  the  contact  and  magnification 
geometries  were  statistically  significant  for  depth  separations  of  2  mm  to  6  mm  at  4  mAs,  and  for  2-nun  separation  at  8  mAs. 
The  differences  between  the  contact-zoom  and  magnification  were  statistically  significant  for  depth  separations  of  2  mm  to  6 
mm  at  4  mAs,  for  2-mm  to  4-mm  separations  at  8  mAs,  and  for  2-mm  separation  at  32  mAs. 

Table  1.  The  average  percentage  of  correct  decision  in  differentiating  the  depths  of  two  crossing  fibrils  in 
stereo  images  acquired  with  contact  geometry  and  displayed  without  zooming. 


Depth 

Separation 

(mm) 

Exposure 

4  mAs 

8  mAs 

32  mAs 

64  mAs 

2 

68.8 

77.6 

87.2 

92.0 

4 

76.7 

94.4 

97.8 

96.7 

6 

90.0 

98.3 

100.0 

100.0 

8 

95.3 

98.8 

97.6 

100.0 

10 

100.0 

100.0 

100.0 

100.0 

Table  2.  The  average  percentage  of  correct  decision  in  differentiating  the  depths  of  two  crossing  fibrils  in 
stereo  images  acquired  with  contact  geometry  and  displayed  with  2X  zoom. 


Depth 

Separation 

(mm) 

Exposure 

4  mAs 

8  mAs 

32  mAs 

64  mAs 

2 

72.8 

83.2 

89.6 

93.6 

4 

81.1 

91.1 

98.9 

100.0 

6 

83.3 

98.3 

100.0 

100.0 

8 

91.8 

96.5 

96.5 

100.0 

10 

100.0 

100.0 

100.0 

100.0 

Table  3.  The  average  percentage  of  correct  decision  in  differentiating  the  depths  of  two  crossing  fibrils  in 
stereo  images  acquired  with  1.8X  magnification  geometry  and  displayed  without  zooming. 


Depth 

Separation 

(mm) 

Exposure 

4  mAs 

8  mAs 

32  mAs 

64  mAs 

2 

92.0 

93.6 

97.6 

98.4 

4 

98.9 

100.0 

100.0 

100.0 

6 

98.3 

100.0 

100.0 

100.0 

8 

100.0 

98.8 

100.0 

100.0 

10 

100.0 

100.0 

100.0 

100.0 

4.  CONCLUSIONS 


This  study  shows  that  the  accuracy  of  depth  discrimination  of  fibrils  in  stereomammography  increases  with  x-ray 
exposure  and  depth  separation  and  depends  on  imaging  geometry.  Depth  discrimination  at  ±3°  stereo  angle  was  reasonably 
good,  2-mm  depth  resolution  was  achieved  with  over  60%  accuracy  for  all  imaging  conditions  studied.  It  improved  to 
greater  than  90%  accuracy  at  higher  doses  and  contact  geometry.  Under  our  experimental  conditions,  zooming  the  contact 
stereo  images  by  2X  did  not  improve  the  accuracy.  When  the  images  were  noisy  and  the  depth  separation  between  the  fibrils 
was  small,  depth  discriminations  were  significantly  better  in  stereo  images  acquired  with  geometric  magnification  than  in 
images  acquired  with  a  contact  technique  and  displayed  with  or  without  zooming.  Magnification  stereomammography 
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provided  over  90%  accuracy  at  2-mm  depth  resolution  for  all  exposure  levels  studied.  These  results  indicate  that 
stereoscopic  imaging,  and  in  particular,  magnification  stereomammography,  may  be  useful  for  visualizing  the  spatial 
distribution  of  microcalcifications  in  a  cluster  and  differentiating  overlapping  tissues  from  masses  on  mammograms.  Further 
studies  are  underway  to  evaluate  use  of  other  stereo  angles  (e.g.,  ±6°)  and  to  investigate  if  specially  designed  cursors  can 
assist  in  depth  discrimination  and  measurement  of  absolute  depths  of  target  objects  in  stereoscopic  images  ’ 
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AbstractID:  9572  Title:  ROC  Study  Comparing  Radiologists’  Performances  in  Evaluating  Breast 
Lesions  on  Stereoscopic  and  Single-Projection  Digital  Specimen  Mammograms 

We  are  evaluating  the  effects  of  stereoscopic  imaging  on  the  interpretation  of  mammographic  lesions.  For  the  present  investigation,  we 
conducted  an  observer  ROC  study  to  compare  radiologists’  performance  in  characterizing  breast  lesions  in  biopsy  tissue  specimens  from  stereo 
and  single-projection  digital  mammograms.  Stereo  and  single-projection  images  of  158  tissue  specimens  were  acquired  with  a  GE  2000D  digital 
mammography  system.  The  images  were  displayed  on  a  DOME/MegaScan  stereo  display  system  and  viewed  with  LCD  glasses.  A  graphical  user 
interface  was  developed  that  allowed  the  user  to  adjust  the  image  display  parameters  and  to  record  the  BI-RADS  assessment  and  confidence 
ratings  on  the  presence  of  microcalcifications  and  masses,  margin  clearance,  and  likelihood  of  malignancy.  A  preliminary  study  was  conducted 
with  two  MQSA  radiologists.  For  one  observer,  the  viewing  of  stereo  images  resulted  in  improvements  in  the  accuracy  of  estimating  the 
likelihood  of  malignancy  (from  Az=  0.72  to  0.74)  and  BI-RADS  assessment  (from  Az=  0.68  to  0.73),  and  increased  confidence  in  judging  margin 
clearance  (p<0.00001).  For  the  other  observer,  the  effect  was  the  opposite  -  reduced  accuracy  in  estimating  the  likelihood  of  malignancy  (from 
Az=  0.76  to  0.70),  reduced  BI-RADS  assessment  (from  Az=  0.77  to  0.72)  and  reduced  confidence  in  judging  margin  clearance  (p<0.03).  These 
results  appear  to  indicate  that  characterization  of  the  lesions  is  correlated  with  the  observer’s  confidence  in  visualizing  the  details  in  the  stereo 
images,  which  may  be  affected  by  the  observer’s  stereo  acuity.  The  observer  study  will  continue  with  additional  radiologists,  and  the  results  will 
be  presented. 
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One  of  the  limitations  of  mammographic  imaging  is  that  overlapping  dense  tissue  in  the 
breast  can  camouflage  true  lesions  or  create  false  lesions  in  the  projected  image.  The  goal 
of  this  project  is  to  develop  a  digital  stereoscopic  imaging  technique  for  mammography.  It 
is  expected  that  overlying  dense  tissues  will  be  separated  from  the  lesion  in  the  stereoscopic 
views,  thereby  increasing  the  conspicuity  of  the  lesion,  and  that  the  ability  to  analyze  the 
3-dimensional  (3D)  distributions  and  shapes  of  lesions  such  as  calcifications  and  masses 
can  potentially  improve  the  accuracy  of  mammographic  interpretation  by  radiologists  and 
reduce  unnecessary  biopsies. 

We  have  investigated  the  dependence  of  depth  discrimination  on  imaging  parameters 
including  the  stereo  angle,  x-ray  exposure,  magnification,  and  display  zoom.  Image  display 
software  was  developed  for  a  high-quality  stereo  viewing  station.  Observer  studies  were 
conducted  to  view  stereo  images  of  3D  mammographic  phantoms  acquired  under  various 
imaging  conditions.  The  accuracy  of  the  observers  in  differentiating  the  relative  depths  of 
two  overlapping  fibrils  was  evaluated.  In  addition,  we  have  developed  3D  virtual  cursors 
for  measurement  of  the  depth  of  objects  in  a  stereomammogram.  The  effects  of  imaging 
parameters  and  virtual  cursor  shapes  on  depth  measurement  accuracy  have  been  studied. 

It  was  found  that  the  accuracy  of  depth  discrimination  increased  with  increasing  stereo 
angle,  exposure,  and  fibril  depth  separation.  Zooming  the  contact  stereo  images  by  2X  did 
not  improve  the  accuracy.  Under  conditions  of  high  noise  and  small  depth  separation 
between  the  fibrils,  depth  discrimination  was  significantly  better  in  stereo  images  acquired 
with  geometric  magnification  than  in  images  acquired  with  a  contact  technique  and 
displayed  with  or  without  zooming.  Magnification  mammography  also  provided  the 
highest  accuracy  for  depth  measurement  with  a  virtual  cursor,  whereas  display  zoom  did  not 
improve  accuracy. 

These  studies  indicate  that  stereoscopic  imaging,  especially  with  magnification,  may  be 
useful  for  differentiating  overlapping  tissues  from  masses  on  mammograms  and  visualizing 
the  spatial  distribution  of  microcalcifications  in  a  cluster,  thereby  improving  the  accuracy  of 
mammography  for  breast  cancer  detection  and  diagnosis. 
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